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OUR HOMOGENEOUS-ABILITY GROUPING CONFUSION 
WARREN W. COXE 
New York State Education De partment 


[nue Ninth Yearbook of the Department of Superintendence lists the 
ntages and disadvantages of homogeneous grouping as stated by 


superintendents of schools. These administrators reported twenty 


intages and twenty-two disadvantages. The advantages were men 
tioned a total of 1326 times, and the disadvantages a total of 867 times. 
( lering these figures alone, it is obvious that the general attitude is 
favorable toward homogeneous grouping. The vote, however, to many 
nds will not be conclusive because there is still evidence of funda- 
ntal disagreement. If we examine specific statements of advantage 
or disadvantage this becomes clearer. For example, 173 superintendents 
state that slow learners in separate groups are more encouraged than 
when competing in classes with fast learners, whereas 150 superin- 
tendents state that the slower groups lose the stimulus and the contribu- 
tions of the faster pupils. These statements are diametrically opposed 
to each other. Both cannot be true except as certain conditions not men- 
tioned are influential. If this is so, the conditions must be understood 
before an explanation of the disagreement can be found. 

Further instanees of contradictory statements can be found as one 
studies the two lists. It is evident that we have not arrived in our 
thinking at the fundamental issue involved. This discussion is an attempt 
to analyze the issues which cause the confusion. 

One of the chief issues is the failure to distinguish between two dis- 
tinet types of grouping both indiscriminately known as ‘‘homogeneous’’ 
nd ‘‘ability’’ grouping. One type, which we will call in this discussion 

homogeneous grouping,’’ attempts a finer classification than is afforded 
by grades. In any grade there is such a wide range of achievement that 
teachers find it difficult to adapt the work and hence the expedient of 


l 
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forming groups 1s tried, sometimes accom panied by attempts to adapt 
methods and amount of subject matter to each of the groups. The aim 
of this kind of grouping is to secure greater achievement in traditiona 
subjects. Another type of grouping, which will be ealled ‘‘ability 
grouping,’’ is an attempt at a new kind of classification rather than 
refinement of the traditional classification. These groups may or maj 
not be as homogeneous as the groups mentioned above. The purpose 1s 
not more efficient teaching of traditional subje ct matter, but the providing 
for different needs of different groups through differentiated curricula 


} 


There is a certain advantage in homogeneous grouping, as above ad 


fined, inasmuch as the teacher distributes her time more equally among 
all pupils, and the faster working pupils do not have to endure th 
slowness of others. If this is the object of the grouping it is natural 
that the success should be measured in terms of achievement in the par- 
ticular subjects which are being taught. Frequently there is no adapta 


; 


ion of subject matter or methods of teaching to the various groups and 
hetter results are expected solely by the simple ad vice of grouping It 
many experiments it is assumed that the same materials and methods be 
used in the experimental group as in the control group. To som 
seems as necessary to keep mate rials and methods the same as to kee] 
the ability of the students the same and to assure themselves that bot! 
experimental and control groups are taught by the s:me teachers o1 
teachers of equal ability. 


} 
| 


\ number of difficulties arise which eventuate in criticism of the sort 
found in the Ninth Yearbook, and of the sort which Dr. J. R. MeGaugh 
has frequently mentioned. In the first place, although homogeneous 
groups may be formed which have less variability than have hetero 
geneous groups, it is obviously impossible to organize groups which ar 
strictly homogeneous—every group will have some variability. This 
variability will be of two sorts: (1) that arising from differences be 
tween pupils, and (2) that arising from uneven development (spec! 
abilities and disabilities) of individual pupils. Beeause of these vari 
tions there inevitably will be a range of achievement in each group a! 
an overlapping between groups, and we will naturally raise a questiot 
as to whether we are not setting up distinctions which are too artificial 
If one reviews the important studies relating to grouping it will | 
found that a very large percentage of them has assumed, explicitly o 


implicitly, some of the positions just mentioned. Whether the groups 


are formed by the use of intelligence tests or achievements tests they at 
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in terms of gain in achievement in particular subjects. Th 
which is faced when achievement tests are used is what type 
to use. In the high school this matter is possibly somewhat easier 
the grades. If a class in algebra is to be divided into ability 
ve may use an algebra test, but in the grades, except in depart 


work, ability groups in each subject are not feasible. Even when 


: are formed in single subjects it 1s frequently found that such 


re not indicative of the amount of progress which different pupils 


ke. Some pupils with low initial achievement make large gains, 


: do not 


of these considerations would seem to lead us to say that homo 
s grouping, as above defined, when carried out strictly according 
ntent, that is, decreasing variability for the purpose of increasing 
ment, does not lead to the desired results and that in th very 
the situation it can not. It should be noted also that several 

s have been made which are not in accord with the best type 

m. Subject matter achievement, while having the sanction of 

n and while greatly facilitating marking and determining promo 
me, and possibly a minor one, of the results W hich should be 
education There probably was a time several hundred 

when the memorization of facts was of tremendous social and 
value. The facts which were good for one generation were 

r the next. Progress was slow. Now, however, what seem to be 
acts to-day may be abandoned tomorrow, and the only residue 
the learning of facts is a technique for obtaining any new facts 

be necessary. In other words, it would seem that to-day when 

re moving very rapidly it is not so much subject matter we need 
ss but rather the techniques by which we may obtain information 
ur problems and develop habits of working, attitudes toward 


nd toward problems, character, personality and other more or 


tangible results. Subject matter becomes a means to an end and 


end in itself 
re is nothing new in this statement. The progressive education 


ent stresses it. Activity periods, project methods and all of the 


devices which have come into being in recent years, are attempts 


K away from old subject matter limitations and to ereate in the 


ew interests, new habits and new traits which are socially valuable. 


we need to-day is to think ear fully how these newer values in edu 


will be affected by an improved method of grouping pupils. 
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This leads to consideration of the second type of grouping, which wi 
have chosen to eall ‘‘ability grouping.’’ The formation of ability groups 
may be identical with homogeneous groups, that is, both may be formed 
on the basis of intelligence tests or on the basis of a composite scor 
from a number of achievement tests, but not upon achievement tests i 
one subject. However, as defined here, ability grouping is differentiate: 
from homogeneous grouping largely by its different aim or purposi 
Ability grouping aims at a better orientation on the part of the pupils 
with life in general, and not at superior achievement in particular sul 
jects as does homogeneous grouping. The purpose is not realized in 
half vear, or in a year, but rather over a period of vears. In general 
its aim is to anticipate the social group in which the boy or girl wil 
find himself when he leaves school. More specifically the aims are thos: 
of the progressive education movement. 

Under this type of grouping, adjustment of subject matter and o 
method to the group which is being taught is of first importance. The 
teaching of a standardized body of subject matter is not an aim. Th 
subject matter is used merely as a vehicle for the training of qualities 
essential in our present civilization. It is for this reason, therefore, that 
no standard achievement is to be expected of any of the groups. The 
teacher is left free to select those materials which will contribute to th: 
ends desired. May it be repeated that the point of differentiation betweer 
homogeneous grouping and ability grouping is that the former is look 
upon as a device for improved achievement in certain standardized sul 
ject matter, whereas the latter is for the purpose of developing certai 
more general abilities, and that subject matter is used merely as a mear 
to this end. 

Problems which arise from ability grouping are numerous, muc! 
more numerous than those involved in homogeneous grouping. This is 
largely because new principles are involved concerning which there is 
not universal agreement at the present time. We are not entirely read; 
to abandon the mastery of a minimum amount of subject matter as 
aim. Superintendents will say that if this is not required, teachers w 
lie down on the job. We do not yet know well enough how to measur 
the sort of results which are here discussed as the desirable aims 
ability grouping. Until we have adequate scales in the fields of cha 
acter, attitudes, personality, habits of study, ete., it will be difficult 


evaluate ability grouping and progress wiil be slow. Also, this raises 


° 
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question: How far do specialized habits and attitudes carry over 


: of-school life? 

a \bility grouping, in the minds of many, runs counter to our ideas of 

_ wy. Many will justify a grouping which is for the purpose of 

. ‘achievement of every individual, but to classify with the expecta 
that the groupings will be permanent arouses opposition. A notion 

ea rent that every boy or girl who has sufficient persistence and 

i m ean achieve any goal. These two traits have an extraordinarily 

= lue, it is true, but they are not the sole determinants of one’s 

" re But even these traits would have a much better chance of 
ypment in ability groups where the expectation held before each 

. ipil is within the range of his ability. There are all sorts of other 
ilties which must be faced before a system of ability grouping 1S 

ess 

: [he distinction which we have attempted to make between homo 

Th re] is and ability grouping should lead research workers and schoo 

1 strators to great care in planning experiments and in evaluating 

ranization involving grouping. In such planning and evaluation the 

+ types of grouping should be differentiated. If this is done much 

Th r thinking and much more helpful results should soon be available 

+} 

_ 

Ie, 
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EXTROVERSION AS A FACTOR CONDITIONING ACHIEVE 
MENT IN THE FIFTH AND SIXTH GRADES OF 
THE ELEMENTARY SCHOOL 
GORDON HENDRICKSO? 
University of Cincinnati 
AND 


JOHN F. HUSKEY 
\ th District Elementary School, Covinaton, Kentucky 


SEVERAL studies have indicated that the introvert succeeds bette 
ac idemieally in high sehool and college than does the extrovert. Exag 
geration of the thought processes at the expense of overt social behavi 
which is the major characteristic of the typical introvert, according 
Freyd,* seems rather naturally to go with relatively high success in t] 
pursuit of book knowledge. However, the theoretical literature on 
troversion-extroversion does not favor the introvert above the extrovy 
from the standpoint of generally desirable personality, and in fact 
inclined to give preterence to the extrovert or to the so-called ambive 

The major problem of the present investigation is to determine whet! 
the rel tionship between introversion-extroversion and school success 
found for secondary and higher education, holds for fifth- and sixt! 
grade elementary school children, Minor problems are to determin 
satisfactory method of measuring extroversion (this term will be us 


hereafter in place of the double term, introversion-extroversion) for 
termediate grade pupils; to study sex differences in extroversion, 
this school level; to determine in detail the relationships, for fifth- 
ide pupils, between age, intelligence, extroversion, and achiev 


ment; and to study sex differences in the relationships between thes 


Tech niqgu and Procedure The subjects of this investigation W 


120 pupils, 48 boys and 72 girls, in the fifth and sixth grades of a publ 


Heidbreder, |} ** Measur ng Introversion and Extroversion,’’ Journal o 
! d Social Psychology, XXI (1926), pp. 120-134 
Powers, N. E. ‘‘An Application of the Marston Introversion-Extroversion 
Seale,’’ Journal of Educational Psychology, XIX 1928), pp. 168-174. 
Young, J. B. ‘‘How Emotional Traits Predispose to College Failure,’’ Jou 
of Educational Psychology, XVIII (1927), pp. 631-636 g 
*Freyd, M ‘*Tntroverts and Extroverts,’’ Psychological Review, XXXI (1924 
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EXTROVERSION CONDITIONING 


1CHIEVE 


MENI ? 


erving a middle-class urban population in Covington, Kentucky 
these was given six ind pend nt ratings for extroversion, and 
sured for intelligence and achievement by standardized tests 


ve been widely used. 


Clip il 
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rsion, 


Ol KE xtrove 


Phree ratings by a 
[wo eclassn 


{ Nheek List oT 


ntelligenes 


ults 


W hieh are 


Was Secl 
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ot the school. the 
il substitute teacher 
children 


ollowing closely The 
lates 


Introvert 


' , a 
Sliehtly modined 


Ability, Intermediate 


vere 


lassroom teachers of 


the 


hy Tilt 


the subjects. 


ce 


school, who is al 


Marston 


for SO the 


prin- 
Rating Seale for 


procedure of its orig 


= 13:4: : 
red. In addition, each 


Thus see 


f the and rated himself, by 


Same Sex, , 
rraits, as used by Heidbreder.* This 


ol 


in the direction of simplicity 
Admi 
Form A 


approximate 


: , 
niste! 


This 


ired Otis Self 


Examinat 


Ion, 


mental 


| YW | (TIS procedure. “7 is Test requires thir minutes ot 
| School Achievement Tests, Battery A, Form 1, prepared 
vere used to measure pupil achievement. These tests cove 

irithmetieal computatiol irithmetical reasoning, lar vyuage 
spelling, and require one hundred eighty minutes of working 
eomposite seo \ elded D these tests was used as vent ral 

} = ‘ 

( S On achievement 


eLatiol ships between extroversion and the ormer Ti 


e st idied In TWO Wavs: first. by class [ving the subjects mm Tine 
the extroversion ratings as extroverts, ambiverts, or introverts 
termining differences between these groups: second. by the use 
ind partial correlations 
n of Extroversion Ratinas Each of the extroversion rat 
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ae T¢ 


rmine th 


eir reliability as applied in t 


een studied as To validity hy 


prey ious investigators, 


his investi 


In general, it is assumed that independent ratings of the same 
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subjects are reliable insofar as they show substantial agreement. [; 


Table I are shown intercorrelations of the ratings by various judges, for 


all the subjects considered together. 


TABLE I 


CORRELATIONS OF EXTROVERSION RATINGS OF 120 SUBJECTS, BY THE VARIOUS JUD 

r P.E 
Substitute with Teacher + .752 027 
Principal with Teacher + .673 033 
Pri pal with Substituts 651 036 
Self with All Other Judges r 1. 238 O58 
Self with Ist Pupil Judg 11 059 
Adult with Pupils and Self 175 059 
Adults wit Fs w Pupils 141 060 
Adults with Self + .140 060 
Self +} nd Pupil Judge j 0 061 
l ] Tudge witl 1 Pupil Judge 028 061 


The correlations between thgaatings of adult judges are high enoug! 


to indicate considerable reliability. None of the ratings by the childrer 


shows much agreement with other ratings. The self-ratings are mor 
significant than the ratings by fellow pupils. 
Under t 


fairly 


ie conditions of this study, the Marston Rating Seale is 
reliable instrument for use by adults in judging fifth and sixt! 
grade children. Little confidence can be placed in ratings made on the 
basis of Freyd’s Check List by pupils of these grades. This statement 
holds whether the pupils are being judged by themselves or by others. 
For the purposes of this investigation, a composite of the three adult 
A techniqui 


and reported by Garrett® was employed to secure 


ratings was used as the one best measure of extroversion. 
Hull 
composite in which the ratings used would be weighted equally. All 
the correlations of Table I 


dev ised by 


composite ratings involved in and in thé 


later tables were obtained by this procedure. 


In Table 


reported the means and standard deviations of the distributions of 


Des ription of Subjects in Terms of the Measures Used. 
I] are 


the subjects by age, intelligence, and achievement. Chronological agi 


The [. Q. 


). was obtained by the 


and mental age are reported in months. 


method prescribed by Otis. The intelligence scores and achievement 


seores are in terms of the original test data. 


‘Hull. C. ‘*The Conversion of Test Seores into Series Which Shall Have At 
Assigned Mean and Degree of Dispersion,’’ Jo il of Applied Psychology, \ 
1922). pp. 298-300 

* Garrett, H E Statistics tn Educat on 

ins, Green & Company, 1926. 


and Psychology. New York: Long 


3 a 


4 
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Vi 


| TABLE II 


STAND » Dy IONS OF ( RONOLA r A | ) 
\ SCORES OF Boy » GIRLS 8 I YA t $4 
) t) = ‘? 
( \ [. A I. Q I S S 
M 141.69 l 8] ) 79 
S [> 11.9 i f 7.6 
! 14 f 18 1.¢ 
S 15 l i 
144.1 l l l ) 
S.D 14.5( i4.4 l 


verage four months older than the boys in chronological 


ir months younger in mental age, but their achievement is as 
t of the boy S. The general level of achievement is elo to 
viven by Orleans for the 6A grade 213 


le III are given the means and standard deviations of the rat 


exTroverslol These have been ealeulated In terms ot the con 
iv? O'S 
vas TABLE ITI 
M D STANDARD DEVIATIONS OF EXTROVERSION R 
AND PUI 
Sy} , 
] \ i Si 
N 1 i 18.98 
‘ S I 13.4 ‘ : - 
17.97 ‘ i4 1 is 4 is 45.61 
5. l 50 l 14 l 14. l 
! M 19.68 19 19 18.46 18.8 18 
( ST) in ¢ j ! . 1 ] 14 
rs 
alt - 4} ‘ h] linat } + +} ] . 9re } } ] . 
il € data in this table iIndleate that the OVS are on the whole more 


‘ls) but are somewhat less variable than the girls 


this trait. The various ratings show close agreement as to both 
\ points 
Differences Between Extroverts. Introverts. and Ambiverts On the 


ne adult extroversion ratings, the subjects were divided into 


ial groups. The upper third will be referred to as extroverts 


ue third as ambive rts, al d the lowe r third as introverts Such 
ge tion is in accord with the assumption that these terms are strictly 
‘ g only relative. both extroversion and introversion being simply 


es of a single seale. Similar divisions were made within the 


boy S ind cirls, to reveal Sex diff rences l tne relatio1 


results for the 48 boys are presented in Table IV. In 


ge, differences are not conspicuous, although the extroverts average 


tly younger than either the introverts or the ambiverts. In intelli 


” i 
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TABLE IV 
COMPARISON OF MEAN CHRONOLOGICAL AGE, INTELLIGENCE, AND ACHIEVEMENT Sct 
or 48 Boys GROUPED AS INTROVERTS, EXTROVERTS, AND AMBIVERTS 7 
Mean Intell ( Otis) Mean A . 
Subjects Mean C.A Mean M.A Score Mean I.Q ment Scor - 
Introverts 16 143.5 134.5 $1.1 94.9 192.7 4 
Extroverts 16 138.1 137.6 33.0 98.9 212.5 ee 
Ambiverts 16 143.3 150.2 37.7 100.7 299 m6 
gence, the results show a tendency for the extroverts to surpass the int: 
verts, although the ambiverts surpass both of the extreme groups. “= 
actly the same tendencies appear for achievement, the superiority 
the extroverts over the introverts and of the ambiverts over bot! : 
other groups being clearly marked. t 
TABLE V 
COMPARISON OF MEAN CHRONOLOGICAL AGE, INTELLIGENCE, AND ACHIEVEMENT Si 
oF 72 GIRLS GROUPED AS INTROVERTS, EXTROVERTS, AND AMBIVERTS : 
Mean Intell ( Otis) Mear 
Subjects Mean ©C.A Mean M.A Score Mean I.Q ment S i 
Introverts 24 152.7 129.6 28.5 88.1 205 \ 
Extroverts 24 144.7 135.2 30.9 93.2 2t 
Ambiverts 4 139.8 141.4 34.3 99.1 216 
Corresponding results for the 72 girls are presented in Table V. Ag 
differences are more marked than for the boys. The introverts are old F 
than the extroverts, and the extroverts older than the ambiverts, T! ; Q, 


over-aged girls apparently are inclined to be at one extreme or the oth 
of the extroversion seale, and are more inclined to be introverted th 
to be extroverted. The averages for mental age, intelligence score, al 
|. ¢ 


ver 


). indieate that the introverts tend to be less intelligent than the ext 


s, and considerably less than the ambiverts. In achievement, 
introverts rate slightly below the extroverts, and the extroverts bel 
the ambiverts. 

The most significant findings for the girls are exactly similar to thos 
for the boys. The ambiverts excel the extreme groups both in int 
gence and achievement, but the extroverts are slightly above the int 
verts in both of these regards. 

Similar tabulations of the results for the entire group of 120 subj 
taken as a whole (not presented here) lead to the same conclusions. 5 
far as these results go, it would appear that at the intermediate g1 
level it promises better for the scholastic success of a pupil for him | 


be extroverted than to be introverted, and better yet for him to be a 


: 
4 
id 
® 
i 
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The tendency for higher intelligence to go with ambiversion 


1s Iso the possibility that a middle standing with re fe rene 


S10 


TO 
n-introversion represents a more intelligent mode of adjust 
see 


fe than an extreme standing. Neither of these findings is in 
rent with the results of previous studies made of high-school and 
students 


f elat ons Between Aae, Intell gence, Extroversion 


and Achieve 
A second treatment of the data is in terms of the partial 


pa cor 
chnique. This treatment neglects the possibility of differences 
e upper, middle, and lower divisions of the subjects, such as 
ly been discussed, and is designed only to get at general ten 


» relationship. 
fables VI and VII ar 


re presented respectively zero-order coeffi 
second-order coefficients, for the relationships between in 


achievement, extroversion, and age. First-order coefficients 
required merely for an intermediate step, are not presented. 
e second-order coefficients, reporting correlations between two 


] i¢ other two factors held eonstant. need TO he a 


LISCLISS( d 


» followed is t! 


at developed by Holzinger’ and the notation 


one for partial correlation problems. 


sure of intelligence is the raw score on the Otis Test. The 
of achievement is the total achievement seore on the Publie 


measure ot ¢ xTtTroversion 18 t} ( composite ot The adult 
‘he measure of age is chronological age in months 


Sm at St of Tne second ord r co ffiei nts for boys is 21 5. for 
ce with age All other coefficients for boys are larger than .30 


onificant of some des 


ee of relationship. 


TABLE VI 


CORRELATIONS BETWEEN INTELLIGENCE (X,), ACHIEVEMENT (X, 
ERSION (X,), AND AGE (X,) FoR 48 Boys AND 72 GIRLS 
Boys G 
r PJ k 
R53 026 778 l 
7 vf ( 52 
‘ 2 aK 290 19 
f } 3 8 
4 8 1 - 
133 14] f 
nger, H. d Statistical Methods Students I ice B ston 
{ mpany L928 
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TABLE VII 
SECOND-ORDER CORRELATIONS BETWEEN INTELLIGENCE (X,), ACHIEVEMENT (X,), 
EXTROVERSION (X,), AND AGE (X,) FoR 48 Boys AND 72 GIRLS 


Index Boys Girls 
ris. + S860 + .776 
Fis.2 342 — O19 
re 213 — 187 
res..4 + 460 —~ 046 
re + 407 +- 073 
ris 317 151 


For boys, the most significant results may be summarized in the stat 
ment that extroversion is positively related to achievement and neg 
tively related to intelligence and age, other factors being kept constan' 
in each ease. Relationships ordinarily found between intelligence, achiev: 
ment, and age, when subjects in a single grade or two adjacent grade 
are studied, maintain for this group of subjects. 

The second-order coefficients for girls are very small, with the e 
ception of the expected positive relationship between intelligence ai 
achievement. It appears that for the girls, extroversion is unrelated 1 
achievement or intelligence\ and negatively related to age, but only t 
very slight degree, other factors being kept constant in each ease. 

The partial correlation technique indicates general trends only, a 
was stated earlier. This procedure, of course, is not adapted to revea 
the type of fact which has been reported concerning the sub-groups \ 
extroverts, introverts, and ambiverts. 

In one major respect, the correlation findings agree with the grou; 
comparisons. The hypothesis that introversion is positively correlat 
with achievement is certainly not tenable for the fifth- and sixth-grad 
children studied. 

The lack of relationship between extroversion and the other factor 
for girls and the negative correlation between extroversion and intel! 
gence for boys are rather surprising, in view of the group comparisons 
It must be remembered that more factors have been kept constant b 
the partial correlation technique than in the group comparisons, 
hence that complete agreement is not to be expected. 


* 
CONCLUSIONS 


Partial correlations i Oe that extroversion is positively related t 
achievement and negatively related to intelligence for boys in the fift! 
and sixth grades, and is practically unrelated to these factors in the cast 
of girls. When the pupils who are at neither extreme of introversion 
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ersion are sorted out, however, they are found to surpass both 
in achieyement and intelligence 


be concluded that it probably augurs better for school success 


eciiate grades to be ambiverted than to he either introverted or 


ted. Whatever may be the case in high school or college. intro 


; 


"4 


no advantage to fifth- and sixth-grade boys and girls, from 
nt of academic achievement. 

idy suggests possibilities ef interest to teachers and admin 
|) Ratings on a carefully prepared seale, such as the Marstor 

be used successfully by teachers and administrators for suc] 


traits as extroversion. 2) The traits which have been 


ed by psychologists and psychiatrists as introverted and ex 

obably do not make for as good academic adjustment as 
rmediate between thes« extremes. 3 Teachers and admin 
may therefore properly study possibilities ot developing per 
long lines of normal adjustment to the world of things and 
ch adjustment not being represented by the extreme of intro 


by the extreme of extroversion 








DIFFERENTIAL PREDICTION OF ABILITY AS REPRESENTED 
BY COLLEGE SUBJECT GROUPS* 
Davip SEGEL 
Specialist in Educational Tests and Measurements, Office of Education 
INTRODUCTION AND STATEMENT OF PROBLEM 

Tue problem of predicting scholastic success has been the subject of 
considerable thought and investigation since the advent of measurement 
in the field of education. The problem is now more pertinent than ever 
owing to the rapid development of public education through the enforce 
ment of compulsory education and the upper extension of education ir 
the junior college. This change in public edueation is in line with our 
recognition of our responsibility for ereating the opportunity for all 
children to develop to the limits of their ability. 

The prediction of scholastie success with the use of tests and meas 
urements in education began with the correlation of marks made by 
pupils one year with the marks made in later years, as was done by Miles.’ 
The advance was made by Kelley? through the use of the multiple r 
gression equation. At first, teachers’ marks were used and then later 
the results of tests and questionnaires were added as items for predic 
tion. All such correlations and predictive equations have been directed 
towards two sorts of criteria. The one criterion of scholastic suecess 
has been the general average of a student’s success in some one year 0! 
in an institution. The other criterion has been the suecess in some 
specific subject or group of subjects. 

On account of the tendencies in the growth of education noted above 
it seems desirable to add a new criterion of scholastic success to the tw: 
already listed. This criterion is the differential prediction of scholasti 
success. If all children must attend school for longer and longer periods 
of time it becomes more and more important that we know in what sub 
jects any specific child is most likely to be successful. The predictior 
of general scholastic success is not always so important since children 
must attend school in any event. Once the fundamentals of education 

*The study reported upon here was carried out under the direction of Dr 
Truman L. Kelley at Stanford University. 

‘Miles, W. R. ‘‘Comparison of Elementary and High School Grades,’’ Unive 
sity of Iowa Studies in Education, I, 1910. 


*Kelley, T. L. Educational Guidance. Contributions to Edueation, No. 71 
New York: Teachers College, Columbia University, 1914. 
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learned the important prediction is that a child will do better 
ne than in another. This is called differential prediction, and 
ent of a method for this kind of prophecy is the problem 


t to solve. This proposition is somewhat analogous to the 


m of the discovery of individual idiosynerasy but is different 
ir problem is a prediction rather than a present determination 

e diseussion of this point we have assumed that there are 
abilities that can be differentiated. We have not made this 
tion in our work but have attempted to show the existence of 
ng scholastie abilities in the field of our endeavor. There is 

ce that there are differentiable mentai abilities in general,* 
restricted field of our investigation it seemed ne eessary in order 
our further work in the calculation of prediction equations, to 
ndependently, by some means, differentiable ability groups. 
ve chosen abilities on the college level as represented by 
ect groups, we have made no attempt to establish the exist 


more elementary abilities in each college subject group, be- 


omplexity involved. Neither have we attempted to account 
f nurture factors in the abilities re presented by our college 
ips. The prediction of differential abilities in and of itself 


stability of the organization of abilities. 


) irticular study involves the prediction of scholastic success at 


ve level, and we shall confine our brief survey, therefore, to 
this level. There are no studies which can be compared di- 
th the results of our study since we are attempting to predict 
‘e, whereas other studies attempt to predict the success for 
lege subjects or for the average of several college subjects. In- 
however, we can compare the success in prediction in our own 

with that of success in other sorts of prediction. 
T indamental measure used as a basis for determining predic 
s the correlation existing between the material used for prediction 
measure of success in the particular thing to be predicted. The 


| used for prediction may be ratings, test scores, answers to 


estionnaires. ete. The search has been. therefore, for suitable ratings, 
S, ( which will give the highest correlations with the criteria and 
/ oe * Interpretation of Educational Measurements. (Yonkers, New 


World Book Con pany, 1927), Chapter V 
‘Kelley, T. L. Crossroads in the Mind of Ma» Stanford Univ ’ 
Spearman. C {bilities of Man. New York: The Macmillan Company, 1927 


ersity Press, 1928. 
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the search for methods for combining such ratings, test scores, ete., so 
that a high correlation with the criteria will result. The criterion of 
success in our study is the difference between mean marks made in vari- 
ous eollege subject groups. Marks have been used almost exclusively 
as criteria of suecess in college. With more eareful achievement testing 
at this level no doubt college success will become better defined. 

The studies of Whitman,’ Root, the Thurstones’?’ and Gowen and 
Gooch,*® give typical results of the relationship between college success 
and other factors using zero order coefficients of correlation. The studies 
of Odell® and that of the Modern Language Survey” give typical results 
of the relationship between college success and other factors using the 
multiple regression equation technique. 

It seems that according to the best investigations on the subject, zero 
order coefficient of correlation between an item and the general criterion 
of college success or the criterion of a single college subject are less than 
50 and that the coefficients of correlation obtained by the multiple re 
gression method between items and any criterion of college success when 
the items are well chosen are less than .60. The correlations usually ob 
tained in investigations of college prediction run somewhat lower than 
the correlations mentioned. 

These correlations indicate that there is much to be desired as far 
as accurate guidance of college students is concerned. The measurement 
of other factors than that of achievement and general ability is as yet 
unsatisfactory. Until interests, character traits, ete. can be measured 
with some degree of facility very high predictions of college suecess 
probably cannot be made. We have, in our study, made use of a meas- 
urement of interest. 

*‘Whitman, A. D. The Value of the Examinations of the Coileaqe Entrance Er- 
amination Board as Predictions of Success in College. New York: Bureau of Pubh 
eations, Teachers College, Columbia University, 1926. 

*Root, A. T. ‘*The Freshman: Thorndike College Entrance Tests, First Semester 
Grades, Binet Tests,’’ Journal of Applied Psychology, VII (March, 1923), pp. 77-92 

*Thurstone, L. L., and Thurstone, Thelma Gwinn. ‘‘The 1929 Psychological 
Examination,’’ Educational Record, XI (April, 1930), pp. 101-128. 

*Gowen, J. W., and Gooch, M. ‘‘The Mental Attainments of College Students 
in Relation to Previous Training,’’ Journal of Educational Psychology, XVI (Novem 
ber, 1925), pp. 547-560. 

*Odell, C. W. ‘*‘ Predicting the Scholastic Success of College Freshmen,’’ College 
of Education Bulletin, No. 37. (Urbana, Illinois: Bureau of Educational Research, 
University of Illinois, 1927), page 33. 

“ Proqnosis Tests in the Modern Foreign Languages. Publications of the Ameri 


can and Canadian Committees on Modern Languages. (New York: The Macmillan 
Company, 1929), Volume XIV. 
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GENERAL OUTLINE OF PROCEDURE AND ORIGINAL DATA 


The differential prediction of college success in this investigation 
means the prediction of a difference of success in pairs of college subject 
groups. The difference in success is measured by the difference in marks 
made by the two college subject groups. For instance in physical science 
subjects a student may make an average or mean mark of 2.4 whereas 
in biological science subjects the same student may make a mean mark 
of 3.1. The difference in marks between these two college subject groups 
is .7 in favor of physical science. We set ourselves the development of 
a method of predicting such differences. 

Differential prediction will not predict college success in general. 
Therefore, in some guidance situations it may be necessary to apply a 
measure of general scholastic ability. Differential prediction does not 
set itself up to take the place of the direct prediction of ability. 

The problem divided itself into three parts. First, we established the 
existence of differentiable mental abilities as represented by certain ecol- 
lege subject groups. Second, we developed the formula necessary to 
predict the differences of suecess between college subject groups and the 
standard error of this formula. Third, we illustrated the use of the 
formula as a practical instrument of prediction. 


THE DATA 


About 200 graduating seniors (class of 1925, Polytechnic High Sehool, 
Long Beach, California) who notified the registrar’s office that they 
expected to attend college were given the following tests and question- 
naires: Van Wagenen Reading History Seale A; Cross English Test 
Form A; Illinois Standardized Algebra Test; Stanford Interest Report 
Blank (also called the Cowdery Interest Questionnaire)"; and Wyman 
Association Test for Interests. 

These particular tests were selected as being possible items valuable 
in the differentiation of success in different college subject groups. The 
first three are too well known to warrant extended comment. The Stan- 
ford Interest Blank was one developed by Dr. Cowdery.” It ean be 


"= This questionnaire was later revised and extended in form by Dr. Edward K. 
Strong, Jr. 

™ Cowdery, Karl M. An Evaluation of the Expressed Attitudes of Members of 
Three Professions: Medical, Engineering, and Legal. Ph.D. Thesis, Stanford Uni- 
versity. (Unpublished), 
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scored in three different ways. Scoring it with one key gives the result 
a positive correlation with interest and ability in law. By scoring it 
another way it gives a positive correlation with interest and ability in 
medicine and a third seoring gives it a positive correlation with interest 
and ability in engineering. 

The other test, the Wyman Association Test for Interests,** has been 
omitted from further consideration owing to the fact that when the re- 
liability coefficient was caleulated it was found to be nearly .00 for the 
three interests it was supposed to measure. This test was made, orig- 
inally, for pupils at the upper elementary school level and this fact 
probably is responsible for its lack of reliability at the upper senior high- 
school level. 

The records made by these students in their college work were ob- 
tained insofar as was possible. The records for the academic years 
1925-26 and 1926-27 were asked for and used. College records for 97 
students were found to be usable in our study out of 115 reports on 
students. We believe we were able to obtain the reports on over 95 
percent of the students enrolling in colleges during the two years above 
mentioned from the original group of 200 that were tested. The college 
records were analyzed for subjects which seem to fall into natural ability 
groups. 

Practically all of the students whose records are used in this study 
attended colleges and universities in Southern California. 


THE DIFFERENTIATION OF THE ABILITIES AS REPRESENTED BY THE MARKS 
MADE IN CERTAIN COLLEGE SUBJECT GROUPS 

After considerable preliminary investigation in the differentiation of 
various college subject groups the following were finally determined upon 
as giving the best possibilities: English; languages; economies; _his- 
tory; biological science; and physical science. 

The language group included all foreign languages. It was composed 
mostly, however, of French, Spanish, and German. The other subject 
groups are self-explanatory. From the marks in the six subject groups 
we ealeulated the reliabilities of and the intercorrelations between the 
groups. The raw data for this work were given in the following form: 


Biological Physical 
Student Languages History Economics Science Science English 
E. B 8 CCC 3.5 CD 3 C $C 3.3 2.7 
pcc CCBC 


* Wyman, Jennie Benson. On the Influence of Interest on Relative Success. 
Ph. D. Thesis, Stanford University. (Unpublished). 
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Each letter is the mark in some particular subject in that subject group. 
To find mean marks the system was adopted where A=1, B=2, C=3, 
D=4, and all failure marks or F’s=5. The reliability of the single 
marks in each subject is given in Table I. All the coefficients of corre- 
lation reported in Table I and in the tables following are based on 
various sized populations taken in all eases from the records of the 97 
students for whom we have college records. In some cases, overlapping 
populations have been used where identical populations would have been 
more desirable because they would have made certain correlations higher. 


, 


We have given for most of the tables the range of P. E.’s. 


TABLE I 
THE RELIABILITIES OF THE INDIVIDUAL MARKS IN COLLEGE SuBJECT GrouUPS 


De: + Cn ness heVhr ne eee nine tate ee ree et ds wade endo wee . ,664 
Tee a ee ee re ee ee ae ——-. 

DD +s csvthavthd coke atecg ee ekaeeeane'’ies ; eee ree .370 
I NIN) erin an ia a bab Wai ge We oO Okee wid oes owe Sees hae 606 
Pens WOONOND oct ncccenssenee PROD CEM ERAN OSS SENS AWEes tttan wee 
EE aes er ee a eee a a ee aoe jae 


The P. E.'s for this table have a range of .02 to .06. 


TABLE II 
INTERCORRELATIONS BETWEEN COLLEGE Sussect Groups Usine INDIVIDUAL MARKS 


Biol. Phys. 
Economics History Science Science English 
oO eee ee ~ &1T .523 392 278 517 
DOD & 6 06 ¢e4e0 eee .296 426 546 187 
| Pee ae B47 165 327 
Biological Science ....... A415 196 
Physical Science ......... .820 


The P. E.'s for this table have a range of .02 to .05. 


TABLE III 
INTERCORRELATION COEFFICIENTS CORRECTED FOR ATTENUATION 


Biol. Phys. 
Economics History Science Science English 
Og aad w Whee .852 1.054 .618 475 .996 
4's sbahevens 06% .643 741 1.004 .388 
OO” es 734 377 B45 
Biological Science ....... 741 395 
Physical Science ......... .697 


Table II gives the intercorrelations between the college subject groups 
using individual marks. All the correlations reported in Tables I to ITT, 
inclusive, have been calculated by the Pearson product moment method, 
correeted for broad ecategories.** 


“ Kelley, T. L. Statistical Method. (New York: The Macmillan Company, 
1923), page 167. 
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We now had the data available for making a good estimate of the 
existence of differentiable groups of college subjects among the particular 
ones investigated. This was done by the application of the formula for 
the correction for attenuation” of the correlations reported in Table II. 
These correlations are reported in Table ITI. 

These correlations represent estimates of the true correlation as to 
suecess between these college subject groups when measured by the 
individual marks since they are correlations resulting when the inade- 
quacies of the measuring instrument have been taken into aecount and 
allowed for. These correlations corrected for attenuation differ consid- 
erably. Any pair of college subject groups that produce a correlation 
near 1.00 indicates that the abilities involved in the two groups were 
nearly the same and that therefore no differentiation can be expected. 
A consideration of the table led us to set down as differentiable the 
following pairs of subject groups: languages and economies; languages 
and biological science; languages and physical science; economics and 
history; economies and biological science; economies and English; his- 
tory and biological science; history and physical science; biological sci- 
ence and physical science; biological science and English; and physical 


science and English. 


THE DEVELOPMENT OF THE DIFFERENTIAL PREDICTION FORMULA AND ITS 
PROBABLE ERROR AND THE CALCULATION OF THE DIFFERENTIAL 
PREDICTION EQUATIONS 

Let X,, X., X,, ete., denote the scores on the tests and questionnaires 
used with the graduating high-school students and let X,, Xe. Xp, ete., 
denote the marks made in the different subjects. If we then determine 
X.— Xe. Xi— Xp. ete., we have differences which we shall eall Xg. 
The problem of prediction then becomes one of finding X,, or in other 
words to find the estimated true differences, and also to find the prob- 
able error of X,4 from which the aceuracy of the prediction ean be judged. 

To find X,q requires the use of the regression equation. The regression 
equation is in general 

X, = bois n X, + Ddozas. n 


' r s. ‘* 
+b on.12 ios aan X, ( 


“Kelley, T. L. Statistical Method. (New York: The Macmillan Company, 
1923), page 204, formula 155. 

* Kelley, T. L. Statistical Method. (New York: The Macmillan Company, 
1923), page 283, formula 249. 
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and C = M, — bousas......... M, ........ 
— b onas........(@n3) MM” 


Therefore the regression equation for X,, i.e., the best estimate of a 
difference in marks in two subject groups, will be as follows: 


Xa = bares........ n X, + Daaas........ i Mvcensnen 
ot (m1) Xa + C 
and C = Mg — b arzs........ » M, — Dasas........2 
M, ae Tree onl. a uae ae (n-1) M, 


(Formula Number 1) 


The standard deviation of the chance factor in X4 has been designated 
vai. The d in the subscript indicates that it is a standard deviation 
concerned with a difference and the i means that the standard deviation 
is that of an individual. To find this error we must consider the chance 
deviation in the seore Xqg. The deviations in Xq comes from the devia- 
tions in X,, X,, ete., in the formula. 


ted cccse' (n-1) X, + C (1) 
Taking any two such equations considering that each X, is equal to 
a true Seore Xo, plus an error designated as E, 


we get 
X xq + Eq = bargs...... a X, + Das.as...... “~~ “Seer +C 
X oq + Ea’ = bares........ n X,’ + bagas....... aagrC (8) 
Subtracting we get 
ta — E*s = bargs........ a (Xo +E, — Xo — E,’) 
- bag Eee n (Xo + E, — Xo aa E,') ete. (4) 
or 
Ey — Eq’ = baa.zs....n (E, — E,’) + baass....n (E, — E,') ete. (5) 
Summing such differences, squaring and dividing by N, we get 
2 0%41=—2 Dares... a @ 31 +2 DO apss.....n O's1 ....:; ete. (6) 
or 
o*4; = b?az.2s........ n o7,, + bd? ao.13 a ete. (7) 
Since 
o*, =e’oao + os 1 and a, = o*w + o*. | ete. (8) 
then 
o7,; = 07, — o’& and o*,; = o*, — ow ete. (9) 


** Ibid., page 283, formula 248. 
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but 


oa =— eo. Nyt and oo = o*, Noi ete. (10) 


therefore 


o,1— 07, — oo, Ty and 7.1 = o*, =o, Ta C8. (11) 
or 
o*,; —o*, (1— Ty and o*,, = o*, (1 — ry) ete. (12) 
Substituting these values of o*,,; in the equation in step (7) we get 
o741 = b* az2o3........0 a”, (3 = By) +b? a213... 2 2 (l- Ton) 
Sdeaessh ban.iz........(a2) on (1 — Pan) 


(Formula Number 2)** 


We next proceeded to the development of the prediction equations for 
our data. 

The zero order correlations with the criteria, i.e., the correlations of 
the test and questionnaire scores with the differences in marks in the 
pairs of subject groups selected are given in Table IV. 

An inspection of this table reveals an interesting relationship be- 
tween the Van Wagenen History Reading Test and relative success in 
the various college subject groups. The correlation coefficients in this 
table, whether positive or negative, give an indication of the success in 
the latter of each subject pair as against the former. The correlations 
for the various pairs with the reading test indicates that this test is more 
related to success in such subjects as economics, physical science, and 
biological science than it is to suecess in history. This relationship which 
was not anticipated seems to be, upon reflection, a probable and natural 
consequence. The Van Wagenen History Reading Test tests ability to 
get meaning from reading material. It can be seen that this ability may 
be more important in such subjects as the sciences and economies than 
in history because these subjects require attention to meaning in a high 
degree, whereas history, although requiring a degree of reading ability 
no doubt, has prebably another factor which is very important. This 
factor is the general memory factor. Success in the sciences and econom- 
ics may be associated more with ability to reason whereas success in 
history may be more associated with ability to recall. The interpretation 
given herewith is put forth as a reasonable explanation of the results 
to which attention has been called, and is in no wise intended to be final 
or conclusive. 

In order to proceed with the calculations it was also necessary to ob- 
tain the intereorrelations between the test items and the reliabilities of 


“TI am indebted to Dr. T. L. Kelley for the derivation of this formula. 
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the test items. The reliabilities were calculated from our own data and 
therefore they cannot be compared directly to reliabilities published for 
these tests and questionnaires since our group is a somewhat selected 
group. In most cases our reliabilities will be found to be lower. Our 
reliabilities were found by splitting the tests in half and using the Spear- 
man-Brown formula. The population in all cases for this purpose was 
fifty. The reliabilities are given in Table V. The intercorrelations are 
given in Table VI. 

We next found the @ regression coefficients or 8 constants and the 
multiple correlation coefficients for each of the college subject group 
pairs for which a difference was to be estimated. We omitted all items 
for the calculation of constants where the correlation with the criterion 
was less than .10 since in general -such low correlations will result in 
little or no value in a regression equation. The 8 constants and the 
multiple correlation coefficients were calculated by the method of suc- 


TABLE IV 
CORRELATIONS OF DIFFERENT ITEMS WITH CERTAIN CRITERIA OF COLLEGE SUCCESS 
ORITERIA 


Difference in Engi- 
marks received in Reading English Algebra Medicine Law neering 
Language, Physics .... .037 —.333 195 —.219 —.236 388 
Language, Economics... 170 —.451 147 —.140 —.122 .299 
Language, Biol. Sc.... 155 .010 .150 —.031 —.287 .098 
Economics, History... .. —.478 .152 —.316 .221 —.023 — .066 
Economics, English .... —.344 057 —.029 —.005 209 .000 
History, Phys. Sc...... 325 182 186 .223 —.277 .232 
Biol. Se., English...... —.046 .022 122 —.257 316 —.163 
Phys. Se., English..... —.179 122 .000 —.032 B57 —.061 
Economics, Biol. Sc.... —.208 151 —.042 317 —.183 .000 
History, Biol. Se...... 825 .142 075 .162 —.267 —.070 
Biol. Se., Phys. Se..... .000 —.065 —.074 —.346 214 .253 


The P. E.'s for the correlations of greater than + .100 for this table range from .08 to .10. 





TABLE V 
RELIABILITY OF TEST ITEMS USED IN THE PREDICTION STUDY 
Van Wagenen Reading............. Seer ere see <s Qe 
i ea aa, Aso. e Os Bo WR Wa lela inw. cae 
CR tre aan doe baivewa ah cee eek eae . 953 
Cowdery Questionnaire Medicine................. sen ees 431 
Cowdery Questionnaire Law.................. 5 miei a 
Cowdery Questionnaire Engineering..................... .465 
TABLE VI 
INTERCORRELATION COEFFICIENTS BETWEEN TEST ITEMS 
Cross Illinois Cowdery Cowdery Cowdery 
English Algebra Medicine Law Engineering 
Van Wagenen Reading..... .330 .204 012 -,015 —.007 
Cross English ........... .062 .170 .060 .106 
Illinois Algebra .......... —.164 —.165 .287 
Cowdery Medicine ........ —.244 —.143 
COG EO cownsoccens —.550 


The P. E.'s for this table range from .05 to .07. 
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cessive approximations.’ This method gives 8 constants and multiple 
correlation coefficients to any degree of accuracy required. We have eal- 
culated our multiple regression coefficients to within .001 of the optimum 
value. The 8 constants are therefore as accurate as necessary for the 
work involved. The pair economies and English have only two correla- 
tions with test and questionnaire items which are more than .10 and 
therefore we have omitted this pair in our further study. The 8 con 
stants and the multiple regression coefficients are given in Table VII. 
The multiple correlation coefficients are in general very superior to the 
zero order coefficients of correlation between the various test items and 
the criteria. This is due to the low intercorrelations between the test 
items. If these intercorrelations were not low our multiple correlation 
coefficients would not be nearly as significant as they now are. 

We have chosen a multiple correlation coefficient of .500 as a critical 
coefficient for determining whether or not we should set up prediction 
equations. This is of course arbitrary although it is a common practic 


TABLE VII 
REGRESSION COEFFICIENTS AND MULTIPLE CORRELATION COEFFICIENTS FOR 
PREDICTION PAIRS 


Languages Languages Languages Economics 
Item and and and and 
Phys. Se Economics Biol. Sec. History 
Reading Test . 394 134 536 
English Test re -.369 —.663 087 .823 
Algebra Test 0x9 014 —.205 
Cowdery Medicine . ; 086 094 —.271 .126 
Cowdery Law . oll 221 
Cowdery Engineering 28 $81 
Multiple Correlation Coefficient 
Resulting , . 555 .694 .333 632 
History Biol. Se Phys. 8c. 
Item and and and 
Phys. Se English English 
Reading Test . — 254 203 
English Test .. ‘ 172 .142 
Algebra Test 169 
Cowdery Medicine . 342 202 
Cowdery Law 378 214 345 
Cowdery Engineering ; es 037 112 
Multiple Correlation Coefficient 
Resulting .... ° 543 .400 427 
Economics History Biol. Se 
Item and and and 
Biol. Se Biol. Sc. Phys. Se 
Reading Test .. ; _ .268 304 
English Test . hee 206 038 
Algebra Test 
Cowdery Medicine 245 098 —.203 
Cowdery Law ‘ ; : 133 245 344 
Cowdery Engineering ... edes 414 
Multiple Correlation Coefficient 
Di. 6 avesdantanenee .438 .432 .480 


“ Kelley, T. L. Statistical Method. (New York: The Macmillan Company, 
1923), page 302. 
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to consider coefficients of less than .50 to indicate prediction efficiency too 
low to be of practical value. Even higher correlations may not bring 
about efficiency of a practical sort. It depends upon other factors in the 
situation. Since we are primarily concerned in establishing a method, 
we are not concerned here especially with establishing this line of demar- 
cation. We find that there are four pairs of groups that have multiple 
correlation coefficients above .50. We have calculated the multiple re- 
gression equations for these four groups and the probable errors of the 
resulting predictive values. The equations and the probable errors were 
calculated by the use of formulae 1 and 2 as established at the beginning 
of this section. 

The equation for predicting a difference in achievement as to marks 
between economics and history in favor of history is as follows: 


X a(ze-n) = — .474 X, + 192 X, — .138 X, 
+ 015 X, + 24.5 
Tai — 2.53 


P.E.4; = 1.71 
Similarly the predictive equations and the probable errors for the 
other three pairs of college subject groups were found to be as follows: 
Languages and economics in favor of economics 
Xaa-gee) = .391 X, — 371 X, + .010 X, 
+ O12 X, + .018 X, + .044 X, + 26.4 
O41 : 4.29 


P.E.4, = 2.89 


languages and physical science in favor of physical science 


Xaa-r) = — .161 X, + 037 X, — 008 X, 
+ 001 X, + .029 X, + 36.3 
Gai — 2.19 


P.E.4; = 1.48 
history and physical science in favor of physical science 
X ap) = .187 X, + .087 X, — .031 X, 
— 029 X, — .003 X, — .2 

Cai — 2.65 

P.E.a, = 1.79 
The reliability coefficients of these predicted measures may be ob- 
tained through the use of the formula’ 04; = og 1 — rap since we 


“Kelley, T. L. Statistical Method. (New York: The Maemillan Company, 
1923), page 222, formula 178a. 
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have oa, given herewith and o, is found in the original data used in 
ealeulating the zero order correlations between the differences in marks 
and the various test items. These reliability coefficients and the standard 
errors used in their caleulations are as follows: 


Prediction Pair Cai oa Yap 
Economies and History............. 2.53 7.47 .88 
Languages and Economies.......... 4.29 7.32 65 
Languages and Physical Science.... 2.19 5.73 86 
History and Physical Science........ 2.65 6.15 81 


We have, in this chapter, explained a new method for the prediction 
of differences of scholastic abilities on the college level. In the next 
chapter we shall explain the practical aspects of the problem, that is, 
the application of the equations established above to the actual predic- 
tion situation. 


(To be continued in the February, 1932, issue of this magazine) 
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THE RELIABILITY OF THE ACCOMPLISHMENT QUOTIENT 


Joun R. McCrory 
State Teaciers College, St. Cloud, Minnesota 

Tue history of educational measurement has witnessed at least two 
major lines of development: the measurement of intelligence and the 
measurement of classroom achievement. Intelligence tests may be con- 
sidered as attempts to measure an individual’s capabilities to achieve. 
Achievement tests, on the other hand, endeavor to measure the amount 
of attainment in specific school subjects. 

In the beginning, educators were content to deal separately with these 
two measures of an individual. As time went on, those interested in 
educational testing realized that a fair and valuable testing program 
must be one in which the results of achievement tests are compared with 
the results of mental tests. To be able to combine the two measures was 
to increase tremendously the significance of both. In the event that a 
combination could be made satisfactorily, answers to such significant 
questions as the following might be expected. How much educational 
achievement can we expect from a child possessed of a given degree of 
intelligence? Is the child of high intelligence accomplishing in his school 
work results commensurate with his ability to do? Is the difference 
between accomplishment and mental ability one that is inherent in the 
individual or inherent in the school situation? Is it possible to equate 
ability and achievement? May such a combined measure be used as an 
incentive to effort? 

Various measures have been proposed by different writers for com- 
paring achievement with capacity to achieve. Among the better known 
measures are the following: the ‘‘achievement quotient’’ introduced by 
the authors of the Illinois Examination; Franzen’s ‘‘accomplishment 
quotient’’;? Franzen’s ‘‘accomplishment ratio’’;> Pintner’s ‘‘differ- 
ence’’ ;* Torgerson’s efficiency quotient’’ ;> Symonds’ ‘‘index of studious- 

*Monroe, W. S., and Buckingham, B. R. ‘‘Illinois Examination: Teacher’s 
Handbook.’’ (Bloomington, Illinois: Public School Publishing Co., 1920), 31 pp. 

? Franzen, R. H. ‘‘The Accomplishment Quotient of School Marks in Terms of 
Individual Capacity,’’ Teachers College Record, XXI (November, 1920), pp. 432-40. 

*Franzen, R. H. ‘‘The Accomplishment Ratio,’’ Teachers College, Columbia 
University Contributions to Education, No. 125. (New York: Bureau of Publications, 
Columbia University, 1922), 59 pp. 

*Pintner, Rudolph, and Marshall, Helen. ‘‘A Combined Mental-Educational Sur- 
vey,’’ Journal of Educational Psychology, XII (January, 1921), pp. 32-48. 


*Torgerson, T. L. ‘‘The Efficiency Quotient as a Measure of Achievement,’’ 
Journal of Educational Research, II (June, 1922), pp. 25-32. 
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ness and effort.’** Terms synonymous with or very similar to achieve- 
ment quotient and accomplishment quotient are: attainment ratio, 
achievement ratio, subject ratio, and educational ratio. It appears that 
the most commonly used of these various measures are the achievement 
quotient and the accomplishment quotient. No doubt the extensive use of 
the Illinois Examination and the Stanford Achievement Test have in 
part accounted for this. Odell,’ in a critical study of the merits and 
demerits of the various proposed measures, recommends the use of the 
‘‘achievement quotient.’’ Both the achievement quotient, and the accom- 
plishment quotient in its original meaning, are found by dividing the 
achievement age by the mental age. Scores on achievement tests are 


converted into achievement ages by means of tables obtained in standardi- 
zation. Mental ages are similarly obtained from an intelligence test. 
Individual diagnosis is the primary purpose for which the accomplish- 
ment quotient, or any other index of the relationship between achieve- 
ment and capacity to achieve, is intended. To perform this function ade- 
quately demands of any measure a high degree of reliability. Several 
writers have challenged very critically the accomplishment and achieve- 
ment quotient techniques from this point of view. In the main, these 
writers have confined their attacks to the consideration of statistical 
limitations and the treatment of empirical data. Toops and Symonds,‘ 
Chapman,’ Ruch,'® Beeson and Tope,"' Herring,’ and Foran, have 
indicated that for a quotient to be reliable it must be derived from in- 


*Symonds, P. M. Measurement in Secondary Education. (New York: The Mac 
millan Company, 1927), pp. 521-25. 

"Odell, C. W. ‘‘A Critical Study of Measures of Achievement Relative to 
Capacity,’’ University of Illinois Bulletin, XXVI (March 19, 1929), pp. 21-34. 

*Toops, H. A., and Symonds, P. M. ‘‘What Shall We Expect of the A. Q.?’’ 
Journal of Educational Psychology, XIII (December, 1922), pp. 513-28; XIV (Janu- 
ary, 1923), pp. 27-38. 

*Chapman, J.C. ‘‘The Unreliability of the Difference Between Intelligence and 
Educational Ratings,’’ Journal of Educational Psychology, XIV (February, 1923), 
pp. 103-8. 

“Ruch, G. M. ‘‘The Achievement Quotient Technique,’’ Journal of Educational 
Psychology, XIV (September, 1923), pp. 334-43. 

“ Beeson, M. F., and Tope, R. E. ‘‘The Educational and Accomplishment Quo- 
tients as an Aid in the Classification of Pupils,’’ Journal of Educational Research, 
IX (April, 1924), pp. 281-92. 

“Herring, J. P. ‘‘The Reliability of Accomplishment Differences,’’ Journal of 
Educational Psychology, XV (November, 1924), pp. 530-38. 

“Foran, G. T. ‘*‘The Meaning and Limitations of Seores, Norms, and Standards 
in Educational Measurement,’’ Educational Research Bulletin, Catholic Education 
Press, III (February, 1928), pp. 16-19; 23-26. 


January, 1932] RELIABILITY OF THE ACCOMPLISHMENT QUOTIENT 29 


telligenece and achievement tests that are themselves reliable. It is sta- 
tistically sound that a quotient will tend to be more unreliable than 
either of the two tests from which it is derived. Most of the intelligence 
and achievement tests possess reliabilities below that considered essential 
for individual diagnosis. 

Only three published studies are known to the writer in which actual 
accomplishment quotient series were correlated to determine accomplish- 
ment quotient reliability. Symonds™ using the National Intelligence 
Tests, the Thorndike-McCall Reading Seale, and the Woody-McCall 
Mixed Fundamentals in Arithmetic, reports reliability coefficients be- 
tween achievement ratios, derived from first and second forms, varying 
from .23 to .60 with probable errors of 6 or 7 points. Popenoe’® using 
the National Intelligence Tests, Woody-MeCall Arithmetic Tests, Thorn- 
dike-MeCall Reading Seale, and the Buckingham Revision of the Ayres 
Spelling Seale, on 600 pupils from grades three to eight, reports a relia- 
bility coefficient of .28 for the accomplishment quotient with a probable 
error of about six points. Odell"® obtained data on the reliability of the 
accomplishment quotient from two groups of pupils. Over 200 fourth 
grade pupils were given both forms of the National Intelligence Test, 
Seale A, and Forms A and B of the Arithmetic Examination of the 
Stanford Achievement Test. A second group of approximately 800 
eighth-grade pupils were given the Illinois General Intelligence Seale, 
Forms 1 and 2. Half of this second group took Forms 1 and 2 of Test II 
of the Monroe Standardized Silent Reading Test, Revised. The other half 
took Forms 1 and 2 of the Monroe General Survey Seale in Arithmetic. 
The obtained accomplishment quotient reliability coefficients varied from 
.39 to .58. A study of the probable errors of measurement showed them 
to amount to about one-tenth of the mean scores. Odell concludes that 
achievement quotients based upon a single administration of the tests 
are so much in error that their use for individual diagnosis is rarely 
if ever justified. 


“Symonds, P. M. ‘‘The Accuracy of Certain Standard Tests for School Section- 
ing and Marking,’’ Journal of Educational Psychology, XV (October, 1924), pp. 
423-32. 

* Popenoe, Herbert. ‘‘A Report of Certain Significant Deficiencies of the Ac- 
complishment Qutient,’’ Journal of Educational Research, XVI (June, 1927), pp. 
40-47. 

* Odell, C. W. ‘‘A Critical Study of Measures of Achievement Relative to 
Capacity.’’ University of Illinois Bulletin, XXVI (March 19, 1929), pp. 44-46. 
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The study here presented was undertaken to provide additional data 
on the reliability of the accomplishment quotient. Its purpose is two-fold: 
1. To determine the reliability of the accomplishment quotient as 
derived from the weighted tests of the Stanford Achievement 
battery. 
2. To determine if possible the factors which most influence the relia- 
bility of the accomplishment quotient and the way in which they 
do influence its reliability. 


A beginning seventh grade in the St. Cloud, Minnesota, Junior High 
School, consisting of 132 students, was given both Forms A and B of 
the Stanford Achievement Tests and Forms A and B of the Terman 
Group Test of Mental Ability. These tests were given the last week of 
September and the first week of October, 1928. Due to absences during 
the testing period, only 110 pupils took both forms of all tests given. That 
these pupils were a rather typical seventh grade group is indicated by 
Table I below. 


TABLE I 


A COMPARISON OF THE CHRONOLOGICAL, MENTAL, AND EDUCATIONAL AGES OF 110 
SEVENTH Grape JUNIOR HigH ScHOOL PuPptILs, St. CLoup, MINNESOTA 


Ages Mean Range 8.D. 
Chronological Age (Months) 152.2 12.82 
+ .82 73 + .58 

Mental Age (Months) 153.46 46 11.22 
+ .72 + 51 

Educational Age (Months) 148.66 56 11.25 
+ .73 + 51 


The mean, range, and S.D. of the chronological, mental, and educa- 
tional ages of the pupils concerned in this study are similar to those 
reported for other seventh grade groups in various school surveys. 

The raw scores on the Stanford Achievement Tests were converted into 
educational ages. The raw scores on the Terman Group Tests of Mental 
Ability were converted into equivalent Binet Mental Ages. Accomplish- 
ment quotients were obtained by dividing edueational ages by mental 
ages. Six accomplishment quotients were obtained for each pupil in the 
following manner :"* 


AS 


“ Three other accomplishment quotients might have been obtained for each pupil: 
dividing the average Stanford A and B educational age by the Terman A mental age; 
by the Terman B mental age; by the average Terman A and B mental age. Because 
of the length of time required to give and score the Stanford Achievement Test it was 
considered impractical to deal with accomplishment quotients derived from an average 
of two forms of the achievement test. 


oe 


oe =a 
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1. Stanford A educational age divided by the Terman A mental age. 
2. Stanford A educational age divided by Terman B mental age. 

3. Stanford B educational age divided by the Terman A mental age. 
4. Stanford B educational age divided by the Terman B mental age. 
5. Stanford A educational age divided by the average Terman A and 


B mental age. 
6. Stanford B educational age divided by the average Terman A and 
B mental age. 
The intereorrelations of these six accomplishment quotients gives fifteen 
reliability coefficients. 

It is of practical importance to the Classroom teacher and the school 
administrator to know what confidence can be placed in an aeccomplish- 
ment quotient derived from a given form of an intelligence test and a 
given form of an achievement test. Specifically, would an aecomplish- 
ment quotient derived from the Stanford A Achievement Test and the 
Terman A Intelligence Test be the same, or approximately the same, as 
an accomplishment quotient derived from the Stanford B and the 
Terman B? Similar questions might be raised for any pair of accom- 
plishment quotients from the six combinations previously indicated. 
Rather definite answers to the above questions may be made from a 
detailed study of the reliability coefficients given in Table IT. 


TABLE II 
SHOWING THE RELIABILITY COEFFICIENTS AND THEIR RESPECTIVE PROBABLE ERRORS, 
BaAsED ON ToTaL Scores, BETWEEN VARIOUS ACCOMPLISHMENT QUOTIENTS 
DERIVED FROM VARIOUS COMBINATIONS OF THE STANFORD ACHIEVEMENT 
TESTS AND THE TERMAN Group TESTS OF MENTAL ABILITY 


Accomplishment Quotients 
A. 





Accomplishment Quotients (2) (8) (4) (5) (6) 
Stanford A—Terman A (1) 50 80 38 86 .69 
.05 .02 .06 .02 .03 

Stanford A—Terman B (2) 37 .72 .76 59 
.06 .03 .03 .04 

Stanford B—Terman A (3) 54 65 87 
.05 04 .02 

Stanford B—Terman B (4) 65 86 
.04 .02 

Stanford A—Ave. Ter. A and B (5) 74 
.03 


Stanford B—Ave. Ter. A and B (6) 


Table II is to be read as follows: the reliability of the accomplishment 
quotients obtained from the Stanford A—Terman A and the Stanford A— 
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Terman B (1 with 2) is 50 + .05; Stanford A—Terman A with Stan- 
ford B—Terman A (1 with 3), is .80 + .02: ete., for each row of relia- 
bility coefficients. 

Ruch and Stoddard" suggest, with hesitation, a rough way in which 
we might evaluate coefficients of reliability. Their suggestions follow: 


Reliability Interpretation or 
Coefficient Significance 
0.95 to 0.99 Very high; rarely found among present tests 
0.90 to 0.94 High; equaled by a few of the best tests 
0.80 to 0.89 Fairly high; fairly adequate for individual measurement 
0.70 to 0.79 Rather low; adequate for group measurement but not 
very satisfactory for individual measurement 
Below 0.70 Low; entirely inadequate for individual measurement 


although useful for group averages and school surveys. 
With the above criteria in mind let us examine the data of Table IT. 
One is impressed with the apparently low reliability of the accomplish- 
ment quotients obtained in this study. The average of the fifteen relia- 
bility coefficients is .66 which when interpreted in accordance with the 
Ruch-Stoddard suggestions is entirely inadequate for individual measure- 
ment. What confidence, one may ask, can be placed in the reliability of 
the Stanford A—Terman A Accomplishment Quotient? Referring to 
row I of Table II, the range of reliability coefficients for this Accom- 
plishment Quotient is from .38 to .86. Three of these reliability co- 
efficients .38, .50, and .69 are low and wholly inadequate for individual 
measurement. The other two .80 and .86 are only fairly reliable for 


TABLE III 
SHOWING THE RANGE OF RELIABILITY COEFFICIENTS AND THE AVERAGE RELIABILITY 
oF Srx ACCOMPLISHMENT QUOTIENTS DERIVED FROM THE STANFORD 
ACHIEVEMENT TEST AND THE TERMAN INTELLIGENCE TEST 


Range of Average Relia- 

Accomplishment Quotients ru2 bility Coefficient 
Stanford A—-Terman A (1) 38 86 .65 
Stanford A—Terman B (2) 37 76 .59 
Stanford B—Terman A (3) 37 — .87 65 
Stanford B—Terman B (4) 38 — 86 .63 
Stanford A—Ave. Ter. A and B (5) 65 — .86 .73 


Stanford B—Ave. Ter. A and B (6) 59 — .87 .75 


“Ruch, G. M., and Stoddard, G. D. Tests and Measurements in High School In 
struction. (Yonkers-on-Hudson, New York: World Book Company, 1927), p. 56. 
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individual measurement. The average reliability of these five coefficients 
is but .65. Each of the remaining five accomplishment quotients may be 
analyzed in the same manner but the conclusion is much the same in each 
case. Table III summarizes the data of Table II thereby permitting 
comparison of the respective average reliabilities of the six accomplish- 
ment quotients. 

An average reliability coefficient of .65 for the Stanford A—Ter- 
man A accomplishment quotient means that predictions of the other 
accomplishment quotients with which it was correlated, from it, or vice 
versa, would be on the average about six-tenths pure guesses.’® Similarly, 
predictions from the Stanford B—Average Terman A and B, which 
accomplishment quotient has the highest average reliability coefficient 
(.75), would be about one-half pure guesses. The presence of such an 
amount of error is not very encouraging when we are thinking about 
individual diagnosis. 

Reliability of the accomplishment quotients of each of the subjects 
in the Stanford Achievement battery was also determined. Only two 
subject accomplishment quotients were determined for each subject. One 
of these was derived by dividing the Stanford A subject age by the 
average of the Terman A and B mental ages; the other by dividing the 
Stanford B subject age by the average of the Terman A and B mental 
ages. Such a combination of the achievement and intelligence tests gives 
a more reliable accomplishment quotient than if only one form of the 
intelligence test were used. The mental age is thus the same in both 
series of quotients. The correlation between the two series of quotients 
provides a measure of their reliability. The results are presented in 
Table IV. 


TABLE IV 


SHOWING THE RELIABILITY COEFFICIENTS OF EACH OF THE SUBJECT ACCOMPLISHMENT 
QUOTIENTS OF THE STANFORD ACHIEVEMENT TEST 


Subject AQ’s bat) 
Reading A and B .82 + .02 
Arithmetic A and B .62 + .04 
Science A and B 63 + .04 
Hist. and Lit. A and B 54+ .05 
Language A and B 39 + .06 
Spelling A and B .88 + .02 





“This result is obtained by determining the coefficient of alienation, VY 1—r’. 
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Interpreting the reliability coefficients of Table IV by the criteria 

of Ruch and Stoddard we may conelude: 

1. The reliabilities of the accomplishment quotients in reading (.82) 
and in spelling (.88) are fairly high and hence, fairly adequate 
for individual diagnosis. It must be remembered, however, that 
with a reliability coefficient of .88 that prediction of one series of 
quotients from that of the other series would involve about 46 
percent pure guesses. 

2. The reliabilities of arithmetic (.62) science (.63), history and lit- 
erature (.54), and language (.39) are low and entirely inadequate 
for individual measurement. 


The data of Table IV show that the accomplishment quotients in the 
various subjects have different degrees of reliability. Two questions 
naturally arise. (1) What factors influence the reliability of the subject 
accomplishment quotient? In what way do these factors influence the 
reliability of the subject accomplishment quotient? In an attempt to 
find an answer to these questions, three factors seemed worthy of study: 
(1) The effect of the correlation between intelligence and achievement ; 
(2) the effect of increasing the reliability of the intelligence test; (3) the 
effect of increasing the reliability of the achievement test. 

Three series of subject accomplishment quotient reliabilities were de- 
termined for each subject as follows: 


Series one = Stanford A—Terman A, SAQ”® 
with 
Stanford B—Terman B, SAQ 
Series two = Stanford A—Ave. Terman A and B, SAQ 
with 





Stanford B—Ave. Terman A and B, SAQ 
Series three = Ave. Stanford A and B—Terman A, SAQ 
with 

Ave. Stanford A and B—Terman B, SAQ 
In series one, the reliability of the intelligence test is .83, correlation of 
Forms A and B. The reliability of the achievement test is .93, correla- 
tion of Forms A and B. It will be observed that the reliability coeffi- 
cients to be yielded in series two are the result of inereasing the relia- 
bility of the intelligence test but keeping the reliability of the achieve- 
ment test the same as that for series one. By combining the two forms 





* SAQ = Subject Accomplishment Quotient. 
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of the intelligence test, its reliability becomes that of an intelligence 
test twice as long. Just what that reliability is can easily be determined 
by application of the Spearman-Brown formula: 


Nr ; 2r 

ea er or in our case 7>— 

In series two the reliability of the intelligence test is increased from .83 
to .90. The reliability coefficients of series three are a result of increasing 
the reliability of the achievement test, but keeping the reliability of the 
intelligence test the same as in series one. As in the ease of the intelli- 
gence test, combining the two forms of the achievement test gives a relia- 
bility of an achievement test twice as long. By application of the Spear- 
man-Brown formula the increase in reliability of the achievement test for 
each subject may be determined. 

Certain hypotheses may be anticipated. If increasing the reliability 
of the intelligence test increases the reliability of the subject aecomplish- 
ment quotient, then all the reliability coefficients of series two should be 
larger than those of series one. If increasing the reliability of the achieve- 
ment test increases the reliability of the subject accomplishment quotient, 
then all the reliability coefficients of series three should be larger than 
those of series one. Kelley** has said that the greater the community 
relation between intelligence and achievement tests (the higher the corre- 
lation between them) the lower will be the reliability of the accomplish- 
ment quotient. If this is correct, then of two achievement tests of equal 
reliability the one having the lower correlation with the intelligence test 
should yield the accomplishment quotient of higher reliability. 

Table V presents data which enable us to examine these hypotheses 
and determine what factors affect the reliability of the subject accom- 
plishment quotient and in what way they combine in their effect. The 
table is to be read as follows: column (1) gives the correlation between 
the Terman Intelligence Test and the Stanford Achievement Test for 
each subject; column (2) gives the reliability of the Stanford Achieve- 
ment Test for each subject; column (3) gives the reliability of the 
Stanford Achievement Test for each subject when Forms A and B are 
combined; column (4) gives the reliability of each subject accomplish- 
ment quotient using a single form of the intelligence test and a single 
form of the achievement test; column (5) gives the reliability of each 





™ Kelley, T. L. Interpretation of Educational Measurements. (Yonkers-on-Hud- 
son, New York: World Book Company, 1927), 299 pp. 
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subject accomplishment quotient using Form A of the Stanford Achieve- 
ment Test and the combined Forms A and B of the Terman Intelligence 
Test; column (6) gives the reliability of each subject accomplishment 
quotient using the combined Forms A and B of the achievement test and 
a single form of the intelligence test. 


TABLE V 
SHowine How THE RELIABILITY OF THE SUBJECT ACCOMPLISHMENT QUOTIENT 1S 
AFFECTED BY THE CORRELATION BETWEEN INTELLIGENCE AND ACHIEVEMENT AND 
BY THE RELIABILITY OF THE INTELLIGENCE AND ACHIEVEMENT TESTS 





Rel. of SAQ =o Rel. of SAQ 
ra = when: ™ oes * ———e 
Saath? 2r m= 83 = quapeees m= 8 
Subjects ria TAA ex oan on Gol. 2 m= 4 $F. os a 
Values TAA = se al ae See 
(1) (2) (3) (4) (5) (6) 
Reading .78 91 95 .69 .82 .80 
Arithmetic .52 .67 81 47 .62 .78 
Science .69 .78 .88 57 .63 80 
Hist. and Lit. .70 -79 87 .50 54 .79 
Language .53 .60 .75 .80 .39 86 
Spelling 52 91 95 .72 88 82 


ru = reliability of the intelligence test. 
ra = correlation between intelligence and achievement. 
tran = reliability of the achievement test. 


> 
a = Spearman-Brown formula for determining reliability when length of test is twice as long 


SAQ = subject accomplishment quotient. 


An examination of the data of Table V relative to the hypotheses 
raised reveals the following facts: 

1. Inereasing the reliability of the intelligence test increases the relia- 

bility of the subject accomplishment quotient. Each of the re- 

liability coefficients of column (5), series two, is higher than its 

corresponding reliability coefficient of column (4), series one. 

2. Increasing the reliability of the achievement test increases the 
reliability of the subject accomplishment quotient. Each of the 
reliability coefficients of column (6), series three, is higher than 
its corresponding reliability coefficient of column (4), series one. 

3. The reliability coefficients of reading and spelling, column (6) are 
lower than the corresponding reliability coefficients of column (5). 
For arithmetic, science, history-literature, and language, the relia- 
bility coefficients of column (6) are higher than the corresponding 
reliability coefficients of column (5). These differences may be 
accounted for by the fact that the achievement tests in reading 
and spelling have high reliability, .91 and .91 respectively, when 
only one form of the achievement test is used. Doubling the length 
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of the achievement test in these subjects adds only 4 points to their 
reliabilities, while doubling the length of the intelligence test adds 
7 points to its reliability. For arithmetic, science, history-litera- 
ture, and language doubling the length of the achievement test 
in these subjects increases the reliability in each instance by a 
greater amount than is the increase which accompanies doubling 
the length of the intelligence test. These facts suggest that the 
test, intelligence or achievement, whose reliability is most increased 
has the greatest effect on the reliability of the subject accomplish- 
ment quotient. 

It will be observed from column (2) of Table V that the reading 
and spelling achievement tests have the same reliability, .91 and 
.91 respectively. Reading correlates with intelligence .78; spelling 
correlates with intelligence .52. A comparison of the accomplish- 
ment quotient reliabilities, column (5), for these two subjects 
shows that spelling with the lower correlation with intelligence 
has the higher accomplishment quotient reliability. The achieve- 
ment tests in seience and history-literature have practically the 
same reliability, .78 and .79 respectively (column 2), but science, 
which has the lower correlation with intelligence, has the higher 
accomplishment quotient reliability (column 5). These facts sug- 
gest that the reliability of the accomplishment quotient is in- 
creased as the correlation between intelligence and achievement 
is decreased. It is probably worthy of note that in ease of science 
and history-literature, though the difference in the correlation 
between intelligence and each test is small (1 point), such differ- 
ence is accompanied by 9 points difference in the reliability of the 
respective subject accomplishment quotients. In the case of read- 
ing and spelling, the difference in correlation with intelligence is 
26 points which is accompanied by a difference of only 6 points 
in subject accomplishment quotient reliability. The explanation 
of this apparent inconsistency seems to be that the higher the 
reliability of the intelligence and achievement tests, the less the 
influence of the correlation between intelligence and achievement. 
Herring” has shown empirically for accomplishment differences 
that with intelligence tests and achievement tests of very high 
reliability (.97 or .98) the correlation between intelligence and 


“Herring, J. P. ‘‘The Reliability of Accomplishment Differences,’’ Journal of 
Educational Psychology, XV (November, 1924), pp. 530-538. 
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achievement matters little. The reading test with a reliability of 
.91, the spelling test with a reliability of .91, and the intelligence 
test with a reliability of .90 are approaching high reliability, and 
hence, the correlation between intelligence and achievement would 
matter less. The science test and the history-literature test, how- 
ever, with reliabilities of .78 and .79 respectively, are low in relia- 
bility, and therefore, we should expect greater influence of the 
correlation between intelligence and achievement. 


GENERAL SUMMARY 

This study has been concerned with an attempt to secure data on the 
reliability of the accomplishment quotient. The subjects used were a 
group of beginning junior high-school students. The tests used to derive 
the accomplishment quotient were: the Stanford Achievement Test, 
Forms A and B, and the Terman Group Tests of Mental Ability, Forms 
A and B. Various combinations of the achievement and intelligence tests 
yielded six accomplishment quotients for each student. The achievement 
age used in determining each of the six accomplishment quotients was 
based on the total score of either Form A or B of the Stanford Achieve- 
ment Test. Accomplishment quotients in reading, arithmetic, seience, 
history and literature, language, and spelling were determined by divid- 
ing achievement ages in these subjects by the average of the Terman 
A and B mental ages. The correlation between parallel series of accom- 
plishment quotients was used as a measure of their reliability. Three 
factors were studied in terms of their influence on the reliability of the 
accomplishment quotient. These factors were: the reliability of the 
intelligence test; the reliability of the achievement test; the correlation 
between the intelligence and the achievement test. The data of the study 
permit the following conclusions: 

1. The average reliability of six accomplishment quotients derived 

from various combinations of the Terman Group Test of Mental 
Ability and the Stanford Achievement Test is only .66. Such a 
reliability coefficient suggests that the accomplishment quotient 
derived from these tests is entirely inadequate for individual 
diagnosis. 
The subject accomplishment quotients in reading and spelling 
were found to be only fairly adequate for individual measure- 
ment. The arithmetic, science, history and literature, and language 
accomplishment quotients as derived from these tests are entirely 
unreliable for individual diagnosis. 
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r of 3. Three factors seem to have decided influence on the reliability of 

nee the accomplishment quotient: the reliability of the intelligence 

and Ff test, the reliability of the achievement test, and the correlation 

uld between the intelligence and the achievement tests. These three 

Ow- § factors appear to affect the reliability of the accomplishment quo- 

lia- Pf tient in the following manner: increasing the reliability of the 

the intelligence test increases the reliability of the accomplishment 
quotient; increasing the reliability of the achievement test in- 
creases the reliability of accomplishment quotient; decreasing the 

he correlation between the intelligence and achievement tests in- 

creases the reliability of the accomplishment quotient. The con- 

line verse of these latter statements also holds. With intelligence 

ae and achievement tests of high reliability, the correlation between 

na intelligence and achievement tests is of minor concern. 

sts Conclusions 1 and 2 above do not necessarily mean that we should 

nt diseard the accomplishment quotient as an index of achievement in terms 

as of capacity to achieve. Rather perhaps, it should be retained but should 

7e- be used cautiously, if at all, in the field of individual diagnosis until such 

ne. time as there are much more reliable intelligence and achievement tests 

d- than now exist. 
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INSTRUCTORS’ USE OF MENTAL TEST SCORES 
CLIFFORD L, CONSTANCE 
University of Oregon 

ADMINISTRATIVE policy in regard to the educational utilization of 
mental test scores depends in part upon the correct answer to this ques- 
tion: ‘‘ Will the scholastic grades given by instructors be influenced by 
knowledge of students’ scores on a previous test of mental ability?’’ A 
small amount of experimental data on this problem is here reported. 

Freshman and sophomore survey courses at the University of Oregon 
are sectioned and divided among several instructors. Three instructors 
taught sections in the particular course under consideration in the fall 
terms of both 1928-29 and 1929-30. In 1928-29 they did not know the 
standing of their students on the University’s entrance mental test (the 
American Council on Edueation Psychological Examination), but in 
1929-30 these scores were entered on their class roll cards at the first of 
the term. The specific problem then was whether the correlation between 
students’ mental test score and the grade received in this course was 
higher in 1929-30 than in 1928-29—higher with knowledge than without 
knowledge of the students’ mental classification. In other words, if in- 
structors are informed of their students’ mental test scores, will a ‘‘ halo 
effect’’ carry over into their grades? 

Data for the entire enrollment of the sections taught by these three 


TABLE I 


CORRELATION BETWEEN MENTAL TEST SCORE AND GRADE IN SURVEY COURSE, 
FOR ENTIRE ENROLLMENT OF THREE INSTRUCTORS 


Chances that 


Correlation Difference in 

Number between Test Correlations 

Instructor Year of Cases Score and Grade Is Significant 
1928-29 169 367 + .045 

A 990 to 10 
1929-30 81 595 + .048 
1928-29 73 390 + .067 

B 519 to 481 
1929-30 119 384 + .053 
1928-29 78 578 + .051 

Cc 691 to 309 
1929-30 54 510 + .068 
1928-29 320 428 + .031 

All Three 865 to 135 
1929-30 254 501 + .032 
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instructors are shown in Table I; instructor A had two sections of this 
course and instructors B and C had one section each. Obviously A’s 
students received grades more in accordance with their mental test 
scores When A knew what those scores were than when he did not. This 
difference, statistically, is highly significant. The tendency for B and C 
is in the opposite direction, but not significantly so. 

To meet the possible objection that differences in level of class ability, 
though slight, might account for discrepancies in correlation coefficients, 
pairing of individuals was utilized to select equally able class groups for 
1928-29 and 1929-30. For each instructor, individual students were 
paired as to mental test score and sex, by random sampling in alphabetical 
order. This limited measurable differences in the experiment to the grades 
received in this particular survey course, the crucial step in any con- 
trolled experimentation. As shown in Table II, the resulting correlation 
coefficients are very similar to those derived from the entire, unpaired 
sections. 

TABLE II 


CORRELATION BETWEEN MENTAL TEST SCORE AND GRADE IN SurvVEY COURSE, FOR 
GROUPS IN SUCCESSIVE YEARS PAIRED AS TO TEST Score, SEX, INSTRUCTOR 


Chances that 


Correlation Difference in 

Number between Test Correlations 

Instructor Year of Cases Score and Grade Is Significant 
1928-29 488 + .057 

\ 80 901 to 99 
1929-30 611 + .047 
1928-29 3857 + .070 

B 71 677 to 323 
1929-30 422 + .066 
1928-29 .509 + .082 

C 37 606 to 394 
1929-30 464 + .087 
1928-29 431 + .040 

All Three 188 896 to 104 
1929-30 522 + .036 


Kelley’s formulas 139 to 129 (Statistical Method, 1923) were used in 
determining the chances for significant differences in Table II, to allow 
for a correlation forced by the pairing of individuals; in Table I his 
formula 140 applied. 

Although it is conceivable that with knowledge of test scores our in- 
structor A adapted his methods and requirements to the variously able 
individuals, the probability seems strong that his judgment of scholastic 
achievement, rather, underwent adaptation. We think these data can be 
taken at practically face value. 
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NOTES ON THE RELIABILITY OF DEARBORN GENERAL 
EXAMINATION © 


Mitton H. Birp AND Epwarp A. LINCOLN 
Harvard University 

THE cases for this study were chosen at random from records on file 
at the Harvard Psycho-Educational Clinic. These records had been 
obtained partly from the testing of a large junior high school in a city 
near Cambridge, Massachusetts, and partly from tests given in a survey 
of a Pennsylvania city conducted by the staff of the Harvard Graduate 
School of Education. The test papers were arranged alphabetically, and 
individual cases were then selected until there were at hand more than 
100 cases for each grade from the sixth to the ninth, inclusive. 

The reliability coefficients were computed by the Spearman-Brown 
technique, using the odd and even items as the two variables. The 
probable errors of measurement were calculated from the formula 
6745 of 1-1, 

The results of this study are set forth in two tables, the first showing 
the reliability measures for the several grades, and the second presenting 
the reliabilities for the various ages. In connection with the second table 
it should be noted that selected groups of the 11-, 15-, and 16-year olds 
were used, because the eases included no children below the sixth grade 
and none above the ninth. Thus the results for these ages are not entirely 
dependable, although there is strong evidence that they are approxi- 
mately correct, since they agree rather closely with one another and 
with the findings for the other ages. 


TABLE I 
RELIABILITY OF DEARBORN GENERAL EXAMINATION C IN GRADES VI TO IX 

Standard Reliability Coefficients P.E. of 
Grade N Deviation Raw Corrected Measurement 
vI 129 10.96 849 918 2.13 
VII 209 10.88 803 898 2.35 
VIII 117 10.50 .719 840 2.87 
IX 110 10.80 .785 880 2.52 
All grades 565 12.33 838 912 2.47 


TABLE II 
RELIABILITY OF DEARBORN GENERAL EXAMINATION C FOR AGES ELEVEN TO SIXTEEN 


Standard Reliability Coefficients P.E. of 
Age N Deviation Raw Corrected Measurement 
ll 53 12.76 865 927 2.27 
12 115 12.24 852 921 2.00 
13 134 11.57 765 .866 2.86 
14 132 13.01 837 912 2.60 
15 73 11.76 .772 871 2.85 
16 29 12.41 814 897 2.68 
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The standard deviations and probable errors of measurement shown 
in the tables are in terms of raw score points. Sheppard’s correction for 
erouping has been applied to all standard deviations. 

An examination of the tables will reveal that the reliability coeffi- 
cient of Dearborn Examination C is about .90 for the ages and grades 
considered. This is high for single age and grade groups. The average 
probable error of measurement is about 2.5 score points. This means a 
probable error of about five months in the mental ages derived from the 
raw seores, and a probable error of three or four points in the intelli- 


gence quotients. 














Se Oe SE 


P=. a 


: EDITORIALS : 
PSE OR ORE FOE ORO OR ROR OE LOR OROROR OE OROROROL OE POE ORO 


COORDINATION OF EDUCATIONAL RESEARCH 


WHEN the educational history of the first half of the twentieth cen- 
tury is written, the third decade of this period will be credited with the 
initiation of a program of coérdination or codperation in educational 
research. This statement should be substantiated by reference to specific 
studies together with dates of publication of the results secured. 

The curriculum field includes the Reorganization of Mathematies in 
Secondary Education (1923), the Classical Investigation (1924-25), and 
the Modern Foreign Language Study (seventee volumes, 1927-31). 
Other completed investigations of large scope include the Character Edu- 
cation Inquiry (three volumes, 1928-30), studies promoted and subsidized 
by the Committee on Administrative Units of the Commonwealth Fund 
(eleven published volumes, 1922-29), six investigations of adult education 
sponsored by the Carnegie Corporation (1926-28), the Educational 
Finance Inquiry (thirteen volumes, 1923-24), the Stanford Genetic 
Studies of Genius (three volumes, 1925-30), the Chicago studies of read- 
ing and arithmetic, and the National Survey of Land Grant Colleges 
made by the Office of Education. Nation-wide coéperative studies yet 
under way include the three surveys by the Office of Education (Seecond- 
ary Education, Teacher Education, and School Finance), the investiga- 
tion of the social studies by the American Historical Association, the 
National study of English usage sponsored by the Psychological Cor- 
poration, and the White House Conference on Child Welfare. 

Illustrations of this method of promoting and organizing educational 
research are found in the work of the great foundations (Carnegie Foun- 
dation for the Advancement of Teaching, Commonwealth Fund, and 
General Education Board), and of professional groups and associations 
both general and subject-matter (National Society for the Study of Edu- 
cation, Department of Superintendence, American Historical Association, 
and National Federation of Modern Language Teachers). The United 
States Office of Education, Research Division of the National Education 
Association, and city, state, and university bureaus of research have been 
active in the coérdination of research in the areas represented. 
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The type of bibliographical and summary work done by Gray in read- 
ing, Buswell and Judd in arithmetic, Lyman in language, grammar, and 
composition, and Curtis in science, as well as the contribution of such 
journals as Psychological Abstracts, Psychological Bulletin, Social Sci- 
ence Abstracts, Teachers Journal and Abstract, and Review of Educa- 
tional Research may be viewed as an aid in the unification of investi- 
gational effort. Publication by universities of series of individual studies 
(Teachers College Contributions to Education and the Chicago Supple- 
mentary Educational Monographs) or of volumes of graduate abstracts 
serves the same purpose. 

This type of codrdinated investigation and publication should break 
down excessive academic isolation in research, prevent wasteful and un- 
necessary duplication of effort, and make readily available and applicable 
the results of major scientific studies to field workers. 

It seems entirely reasonable to expect within the next decade in each 
of the subject-matter fields a survey similar in scope to the Modern 
Foreign Language Study and a summary of the available factual studies 
similar in comprehensiveness to that of Gray in reading. Whatever the 
future may hold, however, in the development of codrdinated large-scale 
research, there is encouragement for the present in the progress here 
reported. The obligation of the field worker is to keep informed concern- 
ing important studies in progress, to coéperate wherever possible, and to 
use the findings reported in the improvement of teaching, curricular, or 
administrative procedures. 

CarTER V. Goop 
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REVIEWS 


Address all communications relative to book reviews to Editor 
E. J. Ashbaugh, Miami University, Oxford, Ohio. 
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Bonser, FrepertcK G. Industrial Arts. 
New York: Teachers College, Colum- 
bia University, 1930. vi + 95 pp. 


Professor Bonser defines industrial arts 
as a school subject as: ‘‘A Study of the 
changes man makes in materials to in- 
crease their values to meet needs, of the 
appropriate usage of products made, and 
of the social advantages and problems 
resulting from the making of these 
changes and produets.’’ This conception 
places industrial arts, in educational 
content with the humanities and the 
sciences. The disciplinary values of 
‘*manual training,’’ ‘‘ manual arts,’’ and 
‘*handwork,’’ getting their content, as 
well as aim, from psychology, have been 
replaced by ‘‘industrial arts’’ with so- 
cial values, receiving its content from 
sociology. 

With such a concept of industrial arts, 
school officials are no longer recognizing 
this school subject as a ‘‘fad’’ or a 
‘*frill,’’ but giving it merited consider- 
ation with other school subjects. ‘‘As a 
field not so well established as the older 
school subjects,’’ Dr. Bonser says, ‘‘in- 
dustrial arts presents many problems to 
the superintendent of schools.’’ 

In concise but clear language the au- 
thor sets forth the same principles as 
expressed in earlier works, such as The 
Elementary School Curriculum by F. G. 
Bonser, and Industrial Arts for Elemen- 
tary Schools by F. G. Bonser and L. C. 
Mossman. Details of content and method 
in connection with the elementary period 
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of schooling are given in all too brief 
form. But the junior and senior high- 
school periods receive more considera- 
tion, especially in details of organiza- 
tion, than in the earlier works. 

The field of industrial arts is so broad 
and its purposes, methods and organiza- 
tion are so varied in the different periods 
of schooling, that it would seem that the 
author might well have increased some- 
what the size of his present work, even 
for the consideration of the busy school 
superintendent. 

Professor Bonser, in his present treat- 
ment of industrial arts, has put in a 
concise form material which might prof- 
itably form the basis for one unit in the 
preparation of the school administrator. 
Even the younger administrators have 
been educated under a_ school system 
which has emphasized verbal and ab- 
stract experiences to the exclusion of 
concrete experiences. Dr. Bonser nicely 
expresses this idea in his statement ‘‘ well 
developed work in the industrial arts and 
closely related subjects would give all 
pupils an opportunity for growth equal 
to that now afforded to the brightest 


only.’’ F. C. Wurrcoms 
Miami University. 


HARTLEY, HELENE W. Tests of the In- 
terpretative Reading of Poetry for 
Teachers of English, New York: 
Columbia University, 1930. v + 47 pp. 
Dr. Hartley’s study purposes to de- 

velop and, somewhat, to standardize 
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objective tests of the intellectual com- 
prehension of poetry. The two avowed 
functions and uses of the tests are, first, 
to determine the perceptive capacities 
of prospective teachers of English so 
far as poetry is concerned, and, second, 
to aid in the development of these per- 
ceptive capacities both of teachers in 
training and of students of poetry in 
general. 

The construction of the tests is 
founded upon the entirely sound assump- 
tion that the development of appreciation 
is in large part based upon the ability 
to comprehend meaning. ‘‘ Meaning,’’ 
however, is not to be understood nar- 
rowly. It concerns not only idea, but 
also mood, fact, image, and experience. 

It follows, therefore, that the tests 
must serutinize the reader’s relation to 
poetry in at least four particulars. 
1. Does the reader perceive ‘‘meanings 
conveyed by figures and symbols’’? 

Does he perceive ‘‘meanings con- 
through sense impressions’’? 

Does he perceive ‘‘ meanings conveyed 
by suggestion or implication as of word 
values or rhythm’’? 4. Does he perceive 
‘‘literal’’? meaning when it is ‘‘ typically 
irregular’’? 


V eyed 


condensed or structurally 
The test, in short, proposes to discover 
whether the reader perceives ‘‘ complete 
meaning,’’ and whether he is sensitive to 
the several media poetry employs to 
achieve its ends, 

The form of the tests is discussed 
briefly, as is the experimental method 
employed in their development. Corre- 
lations with other literature tests of 
similar or dissimilar nature are tabu- 
lated. Forms A and B of the tests are 
included in the appendix of the study. 
The tests may be roughly (but not in- 
accurately) described as comprehension 
tests of the multiple-choice response type. 

This reviewer readily acknowledges 
the soundness of most of the hypotheses 
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of the study and the fitness of the tech- 
niques employed. His questions, as he 
considers the whole study, however, are 
these: Just how much more do we know 
about the prospective teacher as a result 
of his success or failure in the tests than 
we should have been able to discover 
from almost any of the other general 
intelligence tests? Might not either suc- 
cess or failure with the tests often lead 
the examiner to prognosticate most erro- 
neously as to the candidate’s probable 
skill as a high-school teacher? 
Howarp F. SEELEY 
Ohio State University. 


EZEKIEL, Morpecal. Methods of Correla- 
tion Analysis. New York: John Wiley 
& Sons, Ine., 1930. xiv + 427 pp. 
The field of statistics has sometimes 

been divided into the statistics of aver- 
ages, the statistics of variation, and the 
statistics of relationship. The classifica- 
tion leaves something to be desired be- 
cause it ignores some topics and be- 
cause no one of these divisions can be 
adequately considered without calling 
upon the other two. Neverthless the 
classification is significant as an indica- 
tion of emphasis. 

The book by Dr. Ezekiel is a treat- 
ment of the statistics of relationship. It 
bestows no more attention upon averages 
and measures of variation than the de- 
velopment of its special theme re- 
quires. Of all measures of central 
tendency it uses only the mean; and al- 
though in an early chapter the average 
deviation is illustrated, the only measure 
of variation which is really employed is 
the standard deviation. 

This is as it should be. The problem 
of the book is to portray the methods of 
establishing statistical relationships; and 
since these methods require no mean 
but the arithmetic mean and no measure 
of variation but the standard deviation, 
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the treatment of other means and other 
measures of variation would be a di- 
gression. 

Within the field chosen, the reviewer 
knows not where to go for so full and 
so sensible a treatment of the subject. 
Not only will the student find simple, 
partial and multiple correlation dep« ate 
ing upon straight line relationships, to- 
gether with the usual regressions and 
errors of estimate; but he will also find 
a detailed presentation of the same 
concepts based on curvilinear functions. 
There is much, also, about curve fitting, 
but the mathematics of this brane) >of 
the subject is rather disappoint.cy. 
Either the author’s choice of data * 1s 
unfavorable or the occasions when para- 
bolas and logarithmic and _ reciprocal 
eurves will afford a satisfactory ‘‘fit’’ 
are conspicuously few in number. A 
well-drawn free-hand curve was generally 
found to be superior. 

Although most of the problems and 
illustrations are drawn from agricul- 
ture—and especially from agricultural 
economics—the student of psychology or 
education will have no difficulty in trans- 
ferring the methods in his chosen field. 

In connection with linear relationships, 
the author has a preference for using 
r instead of r as a measure of relation- 
ship. He calls r* the coefficient of deter- 
mination. He points out the fact that 
each cofficient of correlation has its cor- 
responding coefficient of alienation, and 
that since the sum of these is greater 
than unity, neither of them can be taken 
as a percent. He points out the sim- 
plicity and usability of a constant which 
enables us to say ‘‘this measures the per- 
eent to which the variance in Y is de- 
termined by X.’’ 

The author’s lucid statement of the 
meaning of the various measures with 
which he deals is in refreshing contrast 
to the arid wastes with which most books 
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on statistics abound. He is aided in this 
by the fact that all his technical discus- 
sions are based on actual problems. But 
this is not all. After he has carried the 
reader through a detailed procedure, he 
stops and surveys its significance. For 
example, after dealing with two varia- 
bles both in rectilinear and curvilinear 
relationship, he gives us a short chapter 
in which he says in substance: ‘‘ Now, 
you may find this confusing, but remem- 
ber that so far as linear correlation is 
concerned three constants tell practically 
the whole story. They are, first, the co- 
efficient of regression, which enables you 
to estimate the value of one variable from 
that of another; second, the standard 
error of estimate, which tells you how 
true that estimate is; and, third, the co- 
efficient of determination (r*) which tells 
the proportion of the variance in one 
variable which can be explained by or 
estimated from the variance of the other 
—the importance of the relation between 
the two variables.’’ 

So far as the reviewer is aware, cer- 
tain topics in the treatment of the re- 
lationship of three or more variables 
are original. This is particularly true 
of parts of the chapters on curvilinear 
multiple correlations; e.g., the develop- 
ment of approximate methods, the dis- 
eussion of non-quantitative factors as 
they affect the dependent variable, and 
the recognition of joint variation. 

Here and there throughout the book 
and especially in the final chapter, the 
author warns the statistical worker not to 
expect his figures to serve purposes 
which they are not intended to serve. 
‘*The correlation analysis itself,’’ he 
says, ‘‘ean never provide the interpreta- 
tion as to cause and effect. It can only 
establish the facts of the relations—for 
the meaning of those facts the investi- 
gator must look elsewhere.’’ Again and 
even more pertinently he concludes: ‘‘ Ex- 


Jan 





cept 
vari 
men 
vesti 
defi 
anal 
anal 
kno 

A 
and 


hig! 
gift 
ine] 
mot 


age 


pri 


pu 
ma 
pu 


col 









No.1 
n this [cept insofar as the effort to reduce the 
iseus- f) variables to specific numerical state- 
But [} ment, definitely related, forces the in- 
d the fvestigator to think more clearly and 
e, he ff} definitely about his problem, statistical 
For ff analysis is not a substitute for logical 
aria- P analysis, clear-cut thinking, and full 
inear | knowledge of a problem.’’ 
upter An excellent book, competently written, 
Now, ff) and wholesome in its point of view. 
nem- B. R. BUCKINGHAM 
m is Harvard University. 
cally 
> CO- LAMSON, E. D. Study of Young Gifted 
you Children in Senior High School. New 
‘rom York: Teachers College Contribu- 
lard tions to Education, 1930, No. 424. 
how viii + 117 pp. 

=> This monograph, after a brief review 
ells | of the literature on gifted children of 
one f high-school ages, presents data on 56 
or f gifted high-school pupils checked 
her against control groups. These 56 pupils 
een f included 19 girls and 37 boys whose 

modal year of high school entrance was 
al 1925. By a random sampling process, 
vied 106 out of 961 pupils entering the same 
les schools in 1925 were selected as the 
rue control group of entrants. In addition 
bar a control group of survivors numbering 
Pp” 110 pupils (a pair for each of 55 gifted 
is- children) was selected from those still 
as ‘‘on register’’ at the time of the study 
nd | of the gifted pupils. Gifted and con- 
trol pairs (survivors) were equated for 

ok age, sex, grade, and school attended. 

he The reviewer commends the care with 
to which this study was planned; the only 
os principal criticism which might be raised 
o is the relatively small number of gifted 
he pupils. (It should be noted that in 
a many of the comparisons the 56 gifted 
ly pupils were still further reduced by in- 
og complete returns on certain items). 

4 The comparisons made covered, prin- 
rt 








January, 1932] REVIEWS 49 


cipally: constancy of intellectual status, 
school achievement and failures, partici- 
pation and interest in extra-curricular ac- 
tivities, health, teachers’ judgments, and 
future plans and attitudes. 

Certain of the major findings follow: 

’. The gifted group for three suc- 
cessive years maintained its status in 
the top centile of intelligence. Of the 
adolescents of the group over fifty per- 
cent reached the top centile of adult 
Army A pha scores. 

2. The gifted group measured from 
5 t 9 points higher than the controls on 
th regents’ examinations and in their 
high-school marks. 

». Gifted earned scholarship honors 
four to nine times more often than the 
controls. 

4. A questionnaire on participation in 
extra-curricular activities showed 4.4 ac- 
tivities for each participating gifted 
child and 3.5 activities when all 56 were 
considered. 

5. On a rating scale (similar to that 
used by Terman in Genetic Studies of 
Genius, Vol. 1) the teachers scored gifted 
significantly higher than control pupils 
on such traits as intelligence, quality of 
school work, and effort. 

6. Of the gifted group, 87.5 percent 
expect to go to college and most of these 
have decided upon a particular college. 

7. No evidence was found that early 
entrance to high school had impaired 
health. 

8. Three-fourths of the gifted pu- 
pils were glad that they had attended 
opportunity classes affording enriched 
programs and rapid progress. 

The Appendix gives considerable de- 
tailed information which is in the na- 
ture of case studies. G. M. Rucu 

University of California. 
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Address all communications relative to research abstracts and 
bibliographies to Editor A. S. Barr, University of Wisconsin, 
Madison, Wisconsin. 


BULLETINS visions for children of atypical men- 


BREED, FREDERICK S., AND OrHeRs. ‘‘Spe- tality. 
cial Methods in the Elementary 
Schools,’’ Review of Educational Re- Dovatass, H. R. ‘*The Relation of 
search, I (October, 1931), 245-323. High School Preparation and Certain 
This issue of the Review of Educa- Other Factors to Academie Success at 
the University of Oregon,’’ TIT, No. 1. 
University of Oregon Publication (Sep- 
tember 1931), 61 pp. 
Contains a statement of the problem, 
CALDWELL, O. W. ‘‘The Work of the In- the sources of data, correlations as meas- 
stitute of School Experimentation,’’ ures of association, high-school marks 
A Reprint from Teachers College Rec- and scholastic achievement in college, the 
ord, XX XIII, No. 2 (November, 1931). pattern of the high-school course and 
scholastic achievement in college, the prin- 
cipal’s ratings on stability, industry, 
leadership and citizenship, schools from 
which students graduated and college 
Character Bwilding: Elementary School ™arks, multiple correlation coefficient and 
Procedures. Kansas City School Ser- "gression equations, summary, interpre- 
viee Bulletin, Series No. 2, IV, Kansas tation and implication. Bibliography. 
City Publie Schools, Mo. (November, 


tional Research is devoted to a summary » 
of investigations relating to special meth- 
ods in the elementary school. 


Setting forth the aims and purposes of 
the institute with a report of projects 
completed or in progress. 


1931), 121 pp. Nosue, Eminy Harrrs. ‘‘ Status and Pro- 
Contains a wealth of materials for the fessional Preparation of Recreation 
use of elementary school teachers in the Center Executives and Workers in Cali 
teaching of character education. fornia, 1929,’’ University of California 
Publications in Education, VI, No. 4. 

OpeELL, C. W. ‘Provisions for Mentally Berkeley, California, 1931. 66 pp. 
Atypical Pupils,’’ University of Mlli- Contains data on the number, profes 
nois Bulletin, XXIX, No. 6. (Septem- sional standards, condition of employ- 
ber 18, 1931), 73 pp. ment, and nature of work for recreation 


Contains a statement of the problem workers in California, the curriculum in 
and chapters on homogeneous groupings, recreation offered in universities, colleges 
special rooms and teachers, miscellaneous and other schools in the United States 
provisions, general programs to provide and Canada with special consideration of 
for children of atypical mentality, and a courses available in California. General 
brief consideration of objections to pro- conclusions, 


50 


J 


P 


January, 1932] 


PREWETT, HATTIE O., Director. The 
Economic Advantage of Special Promo- 
tions: The Amount Saved to the School 
System by Permitting Pupils to Skip 
Half-Grades. Public Schools, Fort 
Worth, Texas, 1931. 27 pp. 

The author presents an analysis of spe- 
cial promotions in the Fort Worth, Texas, 
schools from September 1920 to June, 


1930, 


The Unit Method as a Means for Indi- 
vidualizing Learning Activities, Uni- 
versity of Virginia Record Extension 
Series, XVI, No. 5 (November, 1931), 
54 pp. 

This bulletin presents a series of eight 
papers relating to the unit method as 


ndividualizing learning activities. 


EDUCATIONAL ADMINISTRATION AND 
SUPERVISION 
BRECKINRIDGE, ELIZABETH. ‘‘A Study of 

the Relation of Preparatory School 

Records and Intelligence Test Scores 

to Teaching Success,’’ Educational 

Administration and Supervision, XVII 

(December, 1931), 649-670. 

The author finds that high-school rec- 
ords and intelligence tests score have lit- 
tle predictive value as far as teaching 


success is concerned. 


CAREY, RaAyMOND B. ‘‘The Administra- 
tion of the Finances of Extra-Curricu- 
lar Activities,’’ Educational Research 
Record, IV, No. 1, University of Ne- 
braska Publications (October, 1931), 
5-12. 

The author presents a survey of the 
literature dealing with financial manage- 
ment of extra-curricular activities, and 
the result of a five year experiment in a 
centralized plan of handling extra-cur- 
ricular funds, 
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Certain, C.C, ‘‘An Empirical Basis for 
Scientific Standards in School Li- 
braries,’’ Junior-Senior High School 
Clearing House, VI (December, 1931), 
206-215. 

The author reviews the various steps 
taken in the development of school li- 
brary standards, and presents a new 
score card. 

CUNNINGHAM, MARGARET S 

ment in Class Size in B9 Algebra,’ 

California Quarterly of Secondary Edu- 

cation, VII (October, 1931), 19-28. 


. An Experi- 


A group of 100 pupils was divided into 
two classes of equal ability, one class 
being double in size of the other. Higher 
median and mean scores were found for 


the large group in four quarterly tests. 


Drx, Lester. ‘‘ Judging the Junior High 
School,’’ Educational Administration 
and Supervision, XVII (December, 

1931), 641-648. 

The author presents criteria for judg- 


ing success of junior high schools. 


ELIASSEN, R. H., AND ANDERSON, EARL W. 
‘* Investigations of Teacher Supply and 
Demand Reported November, 
1930,’’ Educational Research Bulletin, 
X, No. 18, Ohio State University (De- 
cember 9, 1931), 479-483. 


since 


A summary of investigations of teacher 
. Lond 
supply and demand reported since No- 


vember, 1930. 


MATZEN, JOHN MATHIASON. ‘‘Codifica- 
tion of Expenditures for School Sup- 
plies,’’ Educational Research Record, 
IV, No. 1, University of Nebraska 
Publication, (October, 1931), 1-4. 
The author presents an analysis of the 

system of codifying expenditure for 

school supplies in the state of Nebraska. 
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NEWLUN, CHESTER. ‘‘ The Selection of 
Basal Readers,’’ The Elementary 
School Journal, XXXII (December, 
1931), 285-293. 

The author presents a set of criteria 
for the selection of readers based upon 
expert opinion. 


Smutz, L. S. ‘*‘The Administration of 
Awards for Non-Physical Education 
Activities in High School,’’ Educa- 
tional Research Record, IV, No. 1, Uni- 
versity of Nebraska Publications (Oc- 
tober, 1931), 16-19, 22-27. 

The author presents analysis of the ad- 
ministration of awards for non-physical 
education activities in high schools. The 
history of the practice of granting 
awards, the attitude of common educa- 
tors for the granting of awards, admin- 
istrative procedures, ete. 


VALENTINER, Dr. To. ‘‘ Erfahrungen bei 
der Sextanerauslese in Bremen (The 
Findings of the Secondary School Se- 
lection Process in Bremen),’’ Zeit- 
schrift fiir Angewandte Psychologie, 
XNXIX (June, 1931), 123-166. 

A description of the technique of test- 
ing, promoting, and eliminating. Due to 
the increasing competition, class merks in 
the first year of the secondary school are 
lower than those obtained by the same 
pupils in the last elementary grade. 

(E. Appelt, University of Wisconsin) 


VAN Dyke, Georce E. ‘‘ Trends in the 
Development of the High-School Offer- 
ing. II,’’ School Review, XXXIX (De- 
cember, 1931), 737-747. 

The second of a series of articles dis- 
cussing trends in the development of 
high-school offerings. Presents an analy- 
sis of a number of courses offered within 
the various subject groups. Programs of 
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study to-day show less standardization 
than they did fifteen or twenty years ago. 


EXPERIMENTAL STUDIES OF LEARNING AND 
TEACHING 


BUSEMAN, ADOLF, UND Baur, GERDA, 
Arbeitslosigkeit und Schulleistung (Un- 
employment of the Father and Achieve- 
ment of the Child),’’ Zeitschrift fiir 
padagogische Psychologie, IX (1931), 
417-421. 

Unemployment of the father lowers the 
grade of achievement of the good pupil 
more than that of the average pupil. (E. 
Appelt, University of Wisconsin) 


CepDERSTROM, J. A. ‘‘Repeaters at the 
College Level,’’ Journal of Applied 
Psychology, XV (August, 1931), 411- 
417. 

The author uses an achievement scale 
in college zoology, Forms A and B, to 
measure the initial status and final status 
of repeaters at the college level. While 
these repeaters start with a higher initial 
seore, this lead is gradually reduced as 
the course progresses. There is little dif- 
ference between the mean scores of re- 
peaters and regular students at the end 
of the course. 


Courtis, 8. A. ‘‘La Courbe de Croissance 
et la Determination Inductive des Ele- 
ments Psychologiques,’’ (The Curve of 
Growth and the Inductive Determina- 
tion of Psychological Elements), Ar- 
chives de Psychologie, (Archives of 
Psychology) XXIII, No. 90 (October, 
1931), 167-178. 

The author presents data on the Curve 
of Growth with a mathematical equation 
for the Ideal Curve. 


CROSLAND, H. R. ‘‘Letter-Position Ef- 
fects, in the Range of Attention Ex- 
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periments, as Affected by the Number 

of Letters in Each Exposure,’’ Journal 

of Experimental Psychology, XIV (Oc- 

tober, 1931), 477-507. 

The author finds that there is a rapid 
decline according to letter-position from 
left to right, with a descending effective- 
ness up to the sixth letter-position, after 
which there is no further decline. 


Gatto, FranK M. ‘‘The Experimental 
Trial of Certain Practice Lessons in 
Silent Reading of the Study Type,’’ 
Bulletin, Pittsburgh Schools, VI, No. 2, 
Board of Public Education (November, 
1931), 92-103. 

An experimental study from which the 
author concludes that groups using spe- 
cially devised practice lessons made 
greater gain than groups not using such 
material, 


GaTTo, FRANK M. ‘‘An Experiment to 
Evaluate the Effectiveness of Two 
Reading Systems in the First Grade,’’ 
Bulletin, Pittsburgh Schools, V1, No. 2, 
Board of Public Education (Novem- 
ber, 1931), 72-92. 

The author presents data relative to an 
equivalent grouping experiment in first 
grade reading. A work book system of 
individual instruction appears superior. 


Hurp, A. W. ‘‘The Textbook versus 
Work Sheets in Instruction,’’ Educa- 
tional Administration and Supervision, 
XVII (December, 1931), 661-664. 
The author compares the textbook and 

work sheet method of instruction. In 
some schools the differences clearly favor 
the work plan, in others the textbook 
plan. On the whole the margin is in 
favor of the work sheet plan. 


KARWOSKI, THEODORE. ‘‘The Memory 
Value of Size,’’ Journal of Experi- 
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mental Psychology, XIV _ (October, 
1931), 539-554. 
An experimental study from which the 
author concludes that size has a memory 
value in proportion as it has attention 


value. 


LUITHLEN, WILHELM F. ‘‘ Zwr Psycholo- 
gie der Initiative und der Fiihrereigen- 
schaften (The Psychology of Initiative 
and the Quality of Leaders),’’ Zeit- 
schrift fiir Angewandte Psychologie, 
XXXIX (June, 1931), 56-122. 

On the basis of theoretical considera- 
tions the author concludes that an ideal 
leader has to possess initiative, ambition, 
and vitality. After having described a 
number of tests given by him, the author 
states that the two-person method of 
measuring character traits is the best way 
of selecting leaders. (E. Appelt, Uni- 
versity of Wisconsin) 


LyMAN, R. L. ‘‘A Co-operative Experi- 
ment in Junior High School Composi- 
tion,’’ School Review, XXXIX (De- 
cember, 1931), 748-757. 

The experiment herein reported was 
conducted by thirty-one teachers working 
with one thousand thirty-nine pupils of 
grades six, seven, eight and nine in 
twenty junior high schools and eleven ele- 
mentary schools in Chicago and vicinity, 
during seven successive weeks of March 
and April, 1931. The codperators felt 
that their pupils grew materially in lan- 
guage consciousness, showed satisfactory 
gains in avoiding minor errors, grew 
accustomed to preliminary plannings, and 
manifested some growth in the quality of 


their compositions. 


LYMAN, R. L. ‘‘Summary of Investiga- 
tions Relating to Grammar. Language, 
and Composition (January, 1929, to 
January, 1931). I,’’? The Elementary 
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School Journal, XXXII (December, 

1931), 266-275. 

An annotated summary of investiga- 
tion relating to grammar, language and 
composition from January, 1929, to Janu- 
ary, 1931. 


McCarty, PeaRL Sanps. ‘‘ Increasing 
Comprehension in Silent Reading,’’ 
School Review, XXXIX (December, 
1931), 758-766. 

Two groups of pupils from grades nine 
and ten in the West Virginia University 
high school served as subjects for this 
study. One group received special train- 
ing in reading; the other received no 
training. The result of the experiment 
show that remedial instruction gave a 
greater, though not a statistically signifi- 
eant, increase in comprehension, 


McGrocu, JoHn A., AND McDONALD, 
Wittiam T. ‘‘Meaningful Relation 
and Retroactive Inhibition,’’ American 
Journal of Psychology, XLIII (Octo- 
ber, 1931), 579-588. 


A study of the relationship which 
exists between the degree of retention of 
memorized material and the kind or 
amount of activity interpolated between 
memorization and the measurement of the 
amount of retention. The learning of 
interpolated lists of adjectives grouped 
in three divisions with respect to their 
degree of synonymy to the original lists 
yields amounts of retroactive inhibition 
which vary directly as the degree of 
synonymy. These results are interpreted 
in favor of a transfer theory of retro- 
active inhibition. 


McTeer, Wiison. ‘‘A Study of Certain 
Features of Punishment in Serial 
Learning,’’ Journal of Experimental 
Psychology, XIV (October, 1931), 453- 
476. 
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After summarizing related investiga- 
tions the author presents an experimental 
study of punishment in serial learning, 
from which he concludes that an electric 
shock of the intensity here used resulted 
in a more cautious attitude on the part 
of the learners. The punished learners 
learned the combinations with fewer 
trials and fewer errors than non-punished 
learners, though the time required was 
the same for both groups. 


ScuMIpBEeRGER, Gustav. ‘‘Uber Schul- 
fleiss wnd Schulaufmerksamkeit bei 
Knaben und Madchen (Diligence and 
Classroom Attention of Boys and 
Girls),’’ Zeitschrift fiir padagogische 
Psychologie, 1X (1931), 392-397. 


Girls are superior to boys at all levels. 
Diligence decreases with increasing age. 
But girls’ diligence marks decrease more 
slowly than boys’ marks. The difference 
between achievement of boys and girls in- 
creases with age. Classroom attention of 
girls is better than that of boys, but the 
difference is not so great as in the case 
of diligence. (E. Appelt, University of 
Wisconsin ) 


Seasnore, Sierrip. ‘‘The Aptitude Hy- 
pothesis in Motor Skills,’’ Journal of 
Erperimental Psychology, XIV (Octo- 
ber, 1931), 555-561. 


After summarizing previous investiga- 
tions the author presents a correlation 
study of motor skills, from which he con- 
cludes that, considering the high relia- 
bility of both the test and the criterion, 
the non-significant correlations found in 
the investigation may be taken as definite 
evidence against the hypothesis of a 
group of basic motor skills as determi- 
nants of practical machine skills, and as 
pointing toward a theory of highly spe- 
cific motor skills. 


pr 
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SreveNSON, EuMo N. ‘‘Children’s Na- 
ture Interests,’’ The Elementary School 
Journal, XXXII (December, 1931), 
276-284. 

The author presents a summary of 
previous investigations relating to chil- 
dren’s nature interests and the result of 
an investigation carried on in the demon- 
stration school of the San Jose State 
Teachers College, San Jose, California. 
The results in general corroborate the 
results of former experiments. The au- 
thor formulates the following principles: 
1) that children are interested in naturs 
objects; (2) that live animals are most 
interesting; (3) that the unusual, unique 
and spectacular things grip the interest 
f children; and (4) that children’s in- 
terests vary from time to time. 


CURRICULUM CONSTRUCTION 
CARPENTER, W. W. ‘‘Curricular Offer- 
ings in Missouri,’’ Junior College 
Journal, II (October, 1931), 16-23. 


’ 


A comparison of the curricular offer- 
ings of the junior colleges in Missouri 
with those of junior colleges in other 


parts of the country. 


DALE, Epgar. ‘‘A Comparison of Two 
Word Lists,’’ Educational Research 
Bulletin, X, No. 18, Ohio State Uni- 
versity (December 9, 1931), 484-489. 

A comparison of the International Kin- 
dergarten Word List with the Thorndike 

Word List. 


DALE, Epegar. ‘‘ Evaluating Thorndike’s 
Word List,’’ Educational Research 
Bulletin, X, No. 17, Ohio State Uni- 
versity (November, 1931), 451-457. 
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The author presents a critical review of 
Thorndike ’s Teacher’s Word Book, pub- 
lished in 1931. 


LINDAHL, HANNAH M. ‘‘ History in the 
Intermediate Grades,’’ The Elementary 
School Journal, XXXII (December, 
1931), 257-265. 

The author presents a discussion of 
recent trends in the teaching of history 
in intermediate grades based upon the 
examination of fifty-seven courses of 
study. He presents a number of conclu- 
sions among those: In actual practice, 
the correlation of history and geography 
is more prevalent at the present time than 
the fusion of the two fields. The three 
leading types of organization are the 
topical, the unit, and the biographical. 


PUPIL ADJUSTMENT, GUIDANCE, AND 
WELFARE 
Supp, Freperic T. ‘‘Social Activities 
of High-School Boys,’’ School Review, 
XXXIX (December, 1931), 767-774. 
From the social activities of high- 
school boys, the author concludes that 
there is a large majority who are socially 
immature and unsophisticated, and more 
attention needs to be given to this large 
group who need additional encourage- 
ment and confidence in their social life. 


MEASUREMENTS, STATISTICS, AND METHODS 
OF EDUCATIONAL RESEARCH 
Baker, Ross A. ‘‘The Relation of the 

Scientific ‘Hunch’ to Research,’’ (Re- 

printed from Journal of Chemical Edu- 

cation, October, 1931), 33 pp. 

The author presents an analysis of sev- 
eral hundred research workers relative to 
the conditions favorable to and unfavor- 


able to research work. 
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DOCTORS’ THESES UNDER WAY IN EDUCATION, 1931-1932 


CarTeR V. Goop 
University of Cincinnati 


INTEREST on the part of professors, 
graduate students, and educational in- 
vestigators in the list of Doctors’ studies! 
in progress last year was so keen that 
the editors of the Journal of Educational 
Research have decided to make this ser- 
vice an annual feature. Comment is 
hardly necessary in pointing out the value 
of such a compilation with respect to 
avoidance of duplication, codrdination of 
effort, and suggestion for further re- 
search. If two students are working on 
similar problems, correspondence or con- 
ference should aid materially in further 
delimitation of the field in such a way 
as to make possible two supplementary or 
complementary contributions rather than 
two reports which duplicate each other 
in many respects. For example, in the 
present list are two studies of the ‘‘ His- 
tory of Teacher Training in the United 
States’’ by students separated by a con- 
tinent. They should profit by comparing 
notes on the scope of the field to be 
covered. In view of the trend toward 
coérdinated research, as illustrated by 
the national surveys of secondary educa- 
tion, teacher training, school finance, 
modern foreign languages, social studies, 
and English usage, it seems only reason- 
able to eliminate duplication of effort 
and to break down some of the provincial 
isolation in working out Doctors’ dis- 
sertations. 

Investigators interested in the titles 
of completed graduate theses in education 
may locate such in the annual bibliogra- 
phies of educational research published 








*Carter V. Good. ‘‘Doctors’ Theses 
Under Way in Education, 1930-1931,’’ 
Journal of Educational Research, XXIII 
(January, 1931), 85-112. 


during recent years by the United States 
Office of Education; for the period pre- 
vious to 1927 this information is found in 
bulletins published by the Bureau of Edu- 
cational Research of the University of 
Illinois. 

Obviously the service rendered by this 
annual compilation of Doctors’ studies in 
progress would be impossible except for 
the coéperation of the various graduate 
schools and departments of education in 
this country.? Only two institutions have 
raised a question with respect to the 
value of publishing such information. 
The reasons given for failure to forward 
their titles are that: (1) some theses 
reported as under way may never be 
finished; (2) too many weak publica- 
tions in education are appearing in print; 
(3) sometimes students do not answer 
satisfactorily inquiries concerning their 
problems under way; (4) there is little 
danger of duplication in educational in- 
vestigation, making unnecessary such a 
list; and (5) publication of a given title 
may prevent some excellent student from 
undertaking a problem on which a weak 
individual is engaged and who never 
finishes it. To answer these objections 
briefly, (1) of course listing of a prob- 
lem under way does not guarantee suc- 
cessful completion of the project; (2) 


? The schools which forwarded titles for 
the present list are: Boston, California, 
Catholic University, Colorado State 
Teachers College, Columbia, Cornell, Har- 
vard, Illinois, Indiana, Iowa, Johns Hop- 
kins, Kansas, Kentucky, Michigan, Mis- 
souri, New York, Northwestern, Ohio, 
Oregon, Peabody, Pennsylvania, Penn- 
sylvania State College, Pittsburgh, South 
Carolina, Southern California, Stanford, 
Temple, Virginia, Texas, Washington, 
West Virginia, Wisconsin, and Yale. 
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the present compilation has no connection 
with present or future publication of 
inferior articles or studies; (3) discour- 
tesy or negligence on the part of recipi- 
ents of inquiries concerning graduate 
theses is to be deplored; (4) there is 
much random overlapping of investiga- 
tional effort and lack of coéperation, co- 
ordination, and planned repetition or 
verification of studies; and (5) the really 
strong student need not be frightened 
away from an area of vital interest in 
which another happens to be working, but 
should profit by knowledge of the scope 
involved and the procedure employed in 
the similar investigation. 

In each instance the name of the can- 
didate, title of the thesis, and graduate 
institution are given, in the order named. 
In most cases the name of the major 
adviser is given following the name of 
the university involved. 

For the convenience of the reader a 
topical index has been prepared. An 
effort has been made to classify each 
thesis title under one or more appropriate 
major divisions of education. The nu- 
meral in each instance refers to the num- 
ber of the thesis in the bibliography 
which is arranged alphabetically by sur- 
names of candidates for the Doctor’s 
degree. No distinction is made between 
Ph.D. and Ed.D. problems. 

Certain problems listed last year are 
reported as still under way. Due to 
limitations of space, these titles are not 
reprinted in the present compilation, but 
are catalogued by number in the topical 
index. The numerals in brackets in the 
index refer to the list in the January, 
1931, number of the Journal of Educa- 
tional Research. However, if a candidate 
in the meantime has changed his problem 
or field of work materially, the new title 
is listed. 
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The alphabetical arrangement employed 
avoids the criticism of calling undue at- 
tention to the efforts of a given institu- 
tion or professor in the graduate field. 
It is possible that certain institutions 
zrant too many degrees; others may 
maintain such rigid standards of selec- 
tion and an atmosphere of aloofness with 
the result that they ‘‘freeze out’’ prom- 
ising students. Some advisers may carry 
too heavy a load, while others are under- 
worked. The tendency toward a profes- 
sionalized degree with a different type of 
thesis may or may not be deplored; this 
problem has been discussed in the 1931 
yearbook of the National Society of Col- 
lege Teachers of Education. Thesis 
standards vary greatly throughout the 
various institutions. Too many weak 
schools may be granting Doctors’ degrees. 
However, these are problems which can- 
not be treated satisfactorily on the single 
basis of a list of studies under way. 

It is the opinion in some quarters that 
too many graduate degrees are granted 
each year. However, if teacher training 
in America is to approach the standards 
of German and French secondary schools, 
there is no cause for immediate alarm 
concerning the number of Doctors’ de- 
grees granted annually, assuming that 
appropriate standards of work are main- 
tained. This statement suggests that a 
study of supply and demand in the 
graduate field, similar to investigations 
in the elementary and secondary teaching 
fields, is needed. Available data indicate 
that the number of Doctors’ degrees 
awarded in education since 1917 is as 
follows: 1918, 53; 1919, 50; 1920, 61; 
1921, 43; 1922, 68; 1923,94; 1924, 110; 
1925, 137; 1926, 181; 1927, 189; 1928, 
194; 1929, 179 (probably not complete) ; 
July, 1929, to September, 1930, 323 
(more than one year represented); 1931, 
354 (approximate). The number of such 
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studies under way in 1930-1931 was more 
than 600. The new theses undertaken 
since the last compilation was printed 
total 468. When the new titles and the 
246 incompleted projects of last year are 
combined, the number of Doctors’ theses 
now under way reaches the total of 714. 


In seanning the titles one receives the 
impression that in some instances a field 
rather than a specific problem is covered. 
This situation probably is due to the fact 
that the student had not delimited his 
problem definitely at the time the titles 
were compiled by the graduate institution. 
Another impression is that the field of 
education in certain institutions has ex- 
tended itself to inelude Doctors’ prob- 
lems in a number of related fields: psy- 
chology, sociology, medicine, religion, eco- 
nomics, history, philosophy, ete., for 
example, ‘‘Studies in Learning by 
Horses,’’ ‘Social Changes in Local 
Neighborhoods,’’ ‘‘The Relation of 
Streptococci Infection to the Fragility 
of the Red Blood Cell,’’ ‘‘The Modern 
‘Holiness’ Movement,’’ ‘‘Slavery and 
Justice,’’ ‘‘ Accounting for No-Par Stock 
Issued by Industrial Corporations Organ- 
ized under the Laws of Delaware, Mary- 
land, and New York,’’ ‘‘The Use of a 
Bantu Culture in Religious Education,’’ 
ete. Opinions differ as to the desira- 
bility of this increasing tendency toward 
expansion in education. 

An examination of the topical index 
indieates that certain fields are investi- 
gated quite frequently, while others are 
seldom explored. As is to be expected, 
school administration and supervision, 
secondary education, elementary educa- 
tion, and psychology and measurement 
provide numerous problems for study. 
The field of educational theory, philoso- 
phy, and sociology makes a respectable 
showing. There is no evidence that the 
historical method is in the diseard in edu- 
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cation; it is true that many studies of 
foreign and comparative education swell 
the total under this heading. One is im- 
pressed by the large number of studies 
touching the college level, which has be- 
come increasingly of late years a center 
of investigational activitiy. However, 
this is a natural development in view of 
the fact that 75 percent of Doctors of 
Philosophy go into college teaching. 

Interest continues in the special fields 
of English, religious and character edu- 
eation, physical and health education, and 
social studies. Character education espe- 
cially seems to be a problem of current 
concern. A body of factual knowledge 
rapidly is being developed in health edu- 
eation. There are still no Doctors’ theses 
under way in art education, and relatively 
few new studies in business education, 
foreign languages, home economics, in- 
dustrial arts, mathematics, music, and 
science. Possibly workers in the foreign- 
language field feel that the Modern For- 
eign Language Study has settled their 
problems for the present; a more likely 
explanation is that relatively few teachers 
of a foreign language take a degree in 
education. The latter statement prob- 
ably applies in the case of a number of 
other special school subjects. 

The type of investigational effort here 
reported gives promise of looming in- 
creasingly large in establishing a factual 
basis for the field of education. 
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